00000001:02000400:2.0F:1789402996.126907:0:3301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789403005.543905:0:3503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789403007.719524:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 665 MB/s 00000001:01000000:1.0F:1789403007.970737:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 784 MB/s 00000001:01000000:2.0:1789403008.223358:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3805 MB/s 00000020:02000000:0.0F:1789403009.158115:0:3595:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gb3cb314 00000400:02000000:2.0:1789403010.310827:0:3610:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.143@tcp [8/256/0/180] 00008000:02000000:0.0:1789403014.143335:0:3759:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789403076.250097:0:5727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789403091.288819:0:6477:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789403091.288827:0:6477:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789403091.288829:0:6477:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789403091.288988:0:6477:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b59a5b14 00000080:02000400:1.0:1789403091.288999:0:6477:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789403091.306075:0:6477:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789403091.306090:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789403091.306132:0:6477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000f2a72a4) 00000020:00000080:1.0:1789403091.306155:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403091.382570:0:6477:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789403091.382662:0:6477:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1789403091.395892:0:6477:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789403091.396094:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789403091.396102:0:6477:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789403091.396114:0:6477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b760694 00000020:01000004:2.0:1789403091.396121:0:6477:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789403091.396126:0:6477:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789403091.396130:0:6477:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b59a5b14 from MGS 00000020:01000004:2.0:1789403091.396133:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789403091.396157:0:6477:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000045a068d4) 00000020:00000080:2.0:1789403091.396170:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789403091.396341:0:6477:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b59a5b14 from MGS, refs=2 00080000:01000000:2.0:1789403091.396347:0:6477:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789403091.396353:0:6477:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7606a2 00000100:00100000:2.0:1789403091.396706:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789403091.396819:0:6477:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789403091.396823:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789403091.397377:0:6477:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789403091.397386:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789403091.398516:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403091.398804:0:6477:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789403091.398811:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789403091.399718:0:6477:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789403091.399726:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789403091.399969:0:6477:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789403091.399976:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789403091.400972:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403091.400977:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403091.400979:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403091.401267:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403091.401270:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403091.401271:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403091.401920:0:6477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789403091.404245:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789403091.651516:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3203 MB/s 00000001:01000000:2.0:1789403091.901549:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5071 MB/s 00000001:01000000:2.0:1789403092.151927:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1255 MB/s 00000001:01000000:1.0:1789403092.401645:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1343 MB/s 00080000:10000000:1.0:1789403092.406022:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1789403092.413234:0:6477:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789403092.414007:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789403092.414055:0:6477:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789403092.414089:0:6477:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789403092.414236:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789403092.414258:0:6477:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789403092.414630:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403092.414773:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789403092.414780:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789403092.415253:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789403092.415260:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789403092.429832:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789403092.429846:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789403092.430504:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789403092.430539:0:6477:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:1.0:1789403092.430541:0:6477:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789403092.430591:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:1.0:1789403092.430604:0:6477:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (00000000ab4077dc) 00000020:00000080:1.0:1789403092.430620:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789403092.430704:0:6477:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000008c773f2@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403092.430895:0:6477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:1.0:1789403092.430903:0:6477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789403092.432245:0:6496:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789403092.433993:0:6497:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789403092.434058:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid ffb2a5d6-5856-4505-b5af-5b30dcef2165) 00000020:00000080:1.0:1789403092.434089:0:6477:0:(genops.c:1384:class_connect()) connect: client ffb2a5d6-5856-4505-b5af-5b30dcef2165, cookie 0x5fb08b1e5b7606b0 00000100:00080000:1.0:1789403092.434102:0:6477:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403092.434113:0:6477:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import 0000000008c773f2 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403092.434154:0:6477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cef90fd9 x1876325050613888/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403092.434182:0:6477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS 00000020:01000004:1.0:1789403092.434201:0:6477:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789403092.434207:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789403092.434222:0:6477:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000001c49a3b) 00000020:00000080:1.0:1789403092.434233:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789403092.435567:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cef90fd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3625:1876325050613888:0@lo:250: 00000100:00100000:3.0:1789403092.435666:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403092.444939:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050613888 00000100:00100000:2.0:1789403092.444954:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050613888 00000100:00100000:2.0:1789403092.444992:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403092.445000:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc723ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3625:x1876325050613888:12345-0@lo:250: 00010000:00080000:2.0:1789403092.445027:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ffb2a5d6-5856-4505-b5af-5b30dcef2165@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:2.0:1789403092.445057:0:6492:0:(genops.c:1384:class_connect()) connect: client ffb2a5d6-5856-4505-b5af-5b30dcef2165, cookie 0x5fb08b1e5b7606be 00000100:00080000:2.0:1789403092.445214:0:6492:0:(import.c:65:import_set_state_nolock()) 0000000042910853 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403092.445298:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc723ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:3625:x1876325050613888:12345-0@lo:250: Request processed in 297us (9632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.445307:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403092.447715:0:3625:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789403092.447734:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:3.0:1789403092.447744:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789403092.447750:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789403092.447754:0:3625:0:(import.c:65:import_set_state_nolock()) 0000000008c773f2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789403092.447758:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789403092.447778:0:3625:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789403092.447785:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cef90fd9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3625:1876325050613888:0@lo:250: 00000100:00100000:1.0:1789403092.451658:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403092.451994:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789403092.452001:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789403092.453078:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789403092.453089:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789403092.453568:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789403092.453577:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789403092.454210:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403092.454762:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789403092.454769:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789403092.455210:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789403092.455217:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1789403092.473872:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403092.488859:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403092.489080:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789403092.489087:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789403092.490448:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789403092.490461:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789403092.492377:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403092.492617:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789403092.492631:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789403092.495935:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789403092.495949:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789403092.496923:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403092.497193:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789403092.497199:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789403092.497793:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789403092.497800:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789403092.498330:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403092.499850:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789403092.499858:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789403092.500411:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789403092.500428:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789403092.518195:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403092.518774:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789403092.518788:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789403092.521262:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789403092.521276:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789403092.523367:0:6477:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789403092.524053:0:6477:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789403092.525334:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789403092.525366:0:6477:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789403092.525373:0:6477:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789403092.525811:0:6477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789403092.525846:0:6477:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789403092.525852:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789403092.525853:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403092.526020:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403092.526023:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403092.526024:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403092.526026:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403092.526027:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403092.526028:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403092.526030:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403092.526031:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403092.526033:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403092.526034:0:6477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403092.526037:0:6477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789403092.526040:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403092.526041:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403092.526042:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403092.526043:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403092.526044:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403092.526045:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403092.526046:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403092.526047:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403092.526048:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403092.526049:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403092.526050:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403092.526051:0:6477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403092.526087:0:6477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789403092.526106:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614016:0@lo:253: 00000100:00100000:1.0:1789403092.526200:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.526307:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028e490bc going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.526586:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614016 00000100:00100000:2.0:1789403092.526593:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614016 00000100:00100000:2.0:1789403092.526674:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403092.526683:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f30cc0e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6477:x1876325050614016:12345-0@lo:253: 20000000:01000000:2.0:1789403092.526730:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789403092.526733:0:6495:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789403092.527096:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789403092.527229:0:6495:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789403092.527741:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403092.529133:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789403092.529351:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789403092.529362:0:6495:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789403092.529368:0:6495:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789403092.529371:0:6495:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789403092.529382:0:6495:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789403092.529594:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403092.530094:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789403092.530109:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789403092.530128:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789403092.530164:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789403092.530182:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789403092.530243:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789403092.530251:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789403092.530263:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789403092.530269:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789403092.530278:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789403092.530282:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789403092.530292:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789403092.530304:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789403092.530326:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789403092.530330:0:6495:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789403092.530336:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403092.530571:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789403092.530579:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789403092.530591:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789403092.530603:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789403092.530615:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789403092.530623:0:6495:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789403092.530708:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789403092.530717:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789403092.530729:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789403092.530742:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789403092.530756:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789403092.530770:0:6495:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789403092.530793:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789403092.530800:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789403092.530820:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789403092.530834:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789403092.531198:0:6495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789403092.531220:0:6495:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789403092.531227:0:6495:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789403092.531580:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789403092.531823:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789403092.531843:0:6495:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.143@tcp for mdt 20000000:01000000:3.0:1789403092.531845:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:3.0:1789403092.531879:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789403092.531887:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789403092.531912:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789403092.531918:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:3.0:1789403092.531943:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789403092.531953:0:6495:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789403092.531965:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789403092.531979:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789403092.532006:0:6495:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789403092.532009:0:6495:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789403092.532014:0:6495:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789403092.532077:0:6495:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789403092.532079:0:6495:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789403092.532989:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789403092.533179:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789403092.533203:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789403092.533217:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789403092.533230:0:6495:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789403092.533232:0:6495:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789403092.534250:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789403092.534598:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789403092.534625:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789403092.534713:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789403092.534727:0:6495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403092.534729:0:6495:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789403092.534736:0:6495:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789403092.534738:0:6495:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789403092.534745:0:6495:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789403092.534752:0:6495:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789403092.535241:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789403092.535361:0:6495:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789403092.543980:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789403092.544023:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789403092.544039:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789403092.544066:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789403092.544094:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544114:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544126:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544132:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544157:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544163:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544170:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026e19e37 already unused, calling callback (0000000042c3b639) 00010000:00010000:2.0:1789403092.544174:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544181:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544195:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544203:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.544209:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789403092.544294:0:6495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789403092.556808:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f30cc0e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6477:x1876325050614016:12345-0@lo:253: Request processed in 30117us (30599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.556825:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403092.558207:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614016:0@lo:253: 10000000:01000000:1.0:1789403092.558228:0:6477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789403092.558231:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789403092.558233:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403092.558234:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403092.558235:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789403092.558237:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403092.558238:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403092.558239:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403092.558241:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403092.558242:0:6477:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789403092.558244:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403092.558245:0:6477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789403092.558276:0:6477:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b59a5b14 from lustre-MDT0000 10000000:01000000:1.0:1789403092.558309:0:6477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789403092.558312:0:6477:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789403092.558317:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a245c9b380 10000000:01000000:1.0:1789403092.558321:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403092.558329:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a245c9b380 from 1 10000000:01000000:1.0:1789403092.558332:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789403092.558371:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.558382:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.558407:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.558426:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614144:0@lo:101: 00000100:00100000:1.0:1789403092.558501:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.558570:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.558857:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614144 00000100:00100000:2.0:1789403092.558865:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614144 00000100:00100000:2.0:1789403092.558910:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403092.558918:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c1076b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6477:x1876325050614144:12345-0@lo:101: 00010000:00010000:2.0:1789403092.558939:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403092.558954:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7606cc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.558980:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.558991:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.559001:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026e19e37, rc 0) 00000100:00100000:2.0:1789403092.559040:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c1076b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:6477:x1876325050614144:12345-0@lo:101: Request processed in 124us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.559046:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403092.559203:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614144:0@lo:101: 00010000:00010000:1.0:1789403092.559217:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.559226:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.559288:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614272:0@lo:501: 00000100:00100000:1.0:1789403092.559314:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.559340:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.559379:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614272 00000100:00100000:2.0:1789403092.559383:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614272 00000100:00100000:2.0:1789403092.559627:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403092.559634:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084306f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:6477:x1876325050614272:12345-0@lo:501: 00000100:00100000:2.0:1789403092.559793:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084306f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:6477:x1876325050614272:12345-0@lo:501: Request processed in 160us (478us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789403092.559800:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403092.559862:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614272:0@lo:501: 10000000:01000000:1.0:1789403092.559901:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789403092.559949:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.559957:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403092.559966:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a244ea0000 10000000:01000000:1.0:1789403092.559970:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789403092.559974:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a244ea0000 10000000:01000000:1.0:1789403092.559977:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789403092.559979:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a244ea0000 from 1 10000000:01000000:1.0:1789403092.559982:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789403092.560002:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.560009:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.560026:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.560038:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614400:0@lo:101: 00000100:00100000:1.0:1789403092.560065:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.560093:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:3.0:1789403092.560113:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614400 00000100:00100000:3.0:1789403092.560120:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614400 00000100:00100000:3.0:1789403092.560168:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403092.560175:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d94ca92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:6477:x1876325050614400:12345-0@lo:101: 00010000:00010000:3.0:1789403092.560185:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403092.560198:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf35c85e/0x5fb08b1e5b7606e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7606da expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.560216:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf35c85e/0x5fb08b1e5b7606e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606da expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.560243:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf35c85e/0x5fb08b1e5b7606e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606da expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.560250:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf35c85e, rc 0) 00000100:00100000:3.0:1789403092.560299:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d94ca92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+7:6477:x1876325050614400:12345-0@lo:101: Request processed in 125us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403092.560305:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403092.560441:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614400:0@lo:101: 00010000:00010000:1.0:1789403092.560453:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.560463:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403092.560474:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789403092.560480:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.560485:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000014db964b/0x5fb08b1e5b7606da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403092.560492:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789403092.560495:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403092.560499:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a244ea0000 10000000:01000000:1.0:1789403092.560502:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789403092.560505:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789403092.560507:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789403092.560530:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.560542:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.560548:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.560559:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614528:0@lo:101: 00000100:00100000:1.0:1789403092.560582:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.560596:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.560821:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614528 00000100:00100000:2.0:1789403092.560826:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614528 00000100:00100000:2.0:1789403092.560845:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403092.560849:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ee48e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+7:6477:x1876325050614528:12345-0@lo:101: 00010000:00010000:2.0:1789403092.560856:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403092.560863:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7606e8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.560886:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.560892:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.560899:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000027f777b, rc 0) 00000100:00100000:2.0:1789403092.560966:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ee48e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+8:6477:x1876325050614528:12345-0@lo:101: Request processed in 116us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.560972:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403092.561609:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614528:0@lo:101: 00010000:00010000:1.0:1789403092.561681:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.561691:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.561758:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614656:0@lo:501: 00000100:00100000:1.0:1789403092.561792:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.561825:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:3.0:1789403092.562075:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614656 00000100:00100000:3.0:1789403092.562082:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614656 00000100:00100000:3.0:1789403092.562125:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403092.562133:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000088bb1a2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+8:6477:x1876325050614656:12345-0@lo:501: 00000100:00100000:3.0:1789403092.563036:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000088bb1a2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6477:x1876325050614656:12345-0@lo:501: Request processed in 901us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403092.563046:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403092.564964:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614656:0@lo:501: 00000100:00100000:1.0:1789403092.565039:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614784:0@lo:503: 00000100:00100000:1.0:1789403092.565130:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.565177:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.565629:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614784 00000100:00100000:2.0:1789403092.565646:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614784 00000100:00100000:2.0:1789403092.565707:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403092.565717:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab56a6e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6477:x1876325050614784:12345-0@lo:503: 00000100:00100000:2.0:1789403092.565854:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab56a6e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6477:x1876325050614784:12345-0@lo:503: Request processed in 139us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.565862:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789403092.566038:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050614784:0@lo:503: 00000100:00100000:2.0:1789403092.567994:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6521:1876325050614912:0@lo:502: 00000100:00100000:2.0:1789403092.568081:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403092.568142:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050614912 00000100:00100000:2.0:1789403092.568142:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e6a912af going to sleep for 11 seconds 00000100:00100000:3.0:1789403092.568153:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050614912 00000100:00100000:3.0:1789403092.568202:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789403092.568211:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000634baada pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6521:x1876325050614912:12345-0@lo:502: 00000100:00100000:3.0:1789403092.568352:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000634baada pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6521:x1876325050614912:12345-0@lo:502: Request processed in 142us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403092.568359:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403092.568600:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6521:1876325050614912:0@lo:502: 00000020:01000000:2.0:1789403092.568629:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403092.568643:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403092.568645:0:6521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789403092.568649:0:6521:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789403092.568652:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403092.568675:0:6521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000499bf1f9) 00000020:00000080:2.0:1789403092.568698:0:6521:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789403092.568706:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789403092.568797:0:6521:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789403092.568805:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7606fd 00000020:00000080:2.0:1789403092.569082:0:6521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789403092.569087:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403092.569091:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403092.569092:0:6521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789403092.569094:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403092.569098:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403092.569099:0:6521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789403092.569105:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403092.569113:0:6521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000046d7daa2) 00000020:00000080:2.0:1789403092.569124:0:6521:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789403092.569127:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789403092.569128:0:6521:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789403092.569131:0:6521:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789403092.569137:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789403092.569202:0:6521:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b59a5b14 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789403092.569217:0:6521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000648455d8) 00000020:00000080:2.0:1789403092.569224:0:6521:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789403092.569293:0:6521:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789403092.569299:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b760712 00000020:00000080:2.0:1789403092.569381:0:6521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789403092.569423:0:6521:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789403092.569428:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb08b1e5b760719 00080000:01000000:2.0:1789403092.569435:0:6521:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789403092.569437:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b760720 00080000:10000000:2.0:1789403092.569904:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789403092.570052:0:6521:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789403092.574886:0:6521:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789403092.682695:0:6521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789403092.683812:0:6521:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789403092.686777:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789403092.687178:0:6521:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789403092.694322:0:6521:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c8369942) 00000020:00000080:2.0:1789403092.694349:0:6521:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789403092.694478:0:6521:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789403092.694489:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b76072e 00000020:00000080:3.0:1789403092.701306:0:6521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789403092.706656:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789403092.713268:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789403092.719358:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1789403092.726315:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789403092.731320:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789403092.733713:0:6521:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789403092.735839:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb08b1e5b760735 00000020:00000080:3.0:1789403092.736216:0:6521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789403092.736243:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403092.736250:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403092.736253:0:6521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789403092.736257:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403092.736262:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403092.736264:0:6521:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403092.736267:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403092.736269:0:6521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789403092.736271:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403092.736273:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403092.736275:0:6521:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789403092.736278:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403092.736282:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403092.736284:0:6521:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789403092.736288:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789403092.736329:0:6521:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789403092.736438:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd77fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6521:1876325050615040:0@lo:502: 00000100:00100000:3.0:1789403092.736541:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403092.736681:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae9674fe going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.736868:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615040 00000100:00100000:2.0:1789403092.736877:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615040 00000100:00100000:2.0:1789403092.737030:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403092.737041:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c47e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6521:x1876325050615040:12345-0@lo:502: 00000100:00100000:2.0:1789403092.737178:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c47e1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6521:x1876325050615040:12345-0@lo:502: Request processed in 140us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.737187:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403092.737284:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd77fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6521:1876325050615040:0@lo:502: 00000020:01000000:1.0:1789403092.737318:0:6521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403092.737324:0:6521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403092.737325:0:6521:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789403092.737329:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789403092.737442:0:6477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789403092.737469:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789403092.737485:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.737497:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403092.737506:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a244ea0000 from 1 10000000:01000000:1.0:1789403092.737510:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403092.737549:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.737557:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.737566:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.737582:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615168:0@lo:101: 00000100:00100000:1.0:1789403092.737612:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.737873:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:3.0:1789403092.738073:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615168 00000100:00100000:3.0:1789403092.738079:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615168 00000100:00100000:3.0:1789403092.738103:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403092.738108:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000018fd0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:6477:x1876325050615168:12345-0@lo:101: 00010000:00010000:3.0:1789403092.738119:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403092.738133:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76073c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.738168:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.738180:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.738189:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038c96b5e, rc 0) 00000100:00100000:3.0:1789403092.738314:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000018fd0d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:6477:x1876325050615168:12345-0@lo:101: Request processed in 205us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403092.738320:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403092.738593:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615168:0@lo:101: 00010000:00010000:1.0:1789403092.738607:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.738625:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.739140:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615296:0@lo:256: 00000100:00100000:1.0:1789403092.739183:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.739215:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:3.0:1789403092.739408:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615296 00000100:00100000:3.0:1789403092.739414:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615296 00000100:00100000:3.0:1789403092.739459:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403092.739465:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a68b3f2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:6477:x1876325050615296:12345-0@lo:256: 20000000:01000000:3.0:1789403092.739482:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789403092.739487:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789403092.739563:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a68b3f2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:6477:x1876325050615296:12345-0@lo:256: Request processed in 98us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403092.739570:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403092.739717:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615296:0@lo:256: 10000000:01000000:1.0:1789403092.740355:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403092.740375:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.740385:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403092.740585:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a244ea0000 from 1 10000000:01000000:1.0:1789403092.740589:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403092.740619:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.740627:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.740636:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.740651:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615424:0@lo:101: 00000100:00100000:1.0:1789403092.740691:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.740828:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022dfb0ed going to sleep for 11 seconds 00000100:00100000:0.0:1789403092.740978:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615424 00000100:00100000:0.0:1789403092.740986:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615424 00000100:00100000:0.0:1789403092.741067:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403092.741074:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da636c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:6477:x1876325050615424:12345-0@lo:101: 00010000:00010000:0.0:1789403092.741085:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403092.741099:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76074a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403092.741120:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403092.741129:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403092.741138:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041191478, rc 0) 00000100:00100000:0.0:1789403092.741182:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da636c5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6477:x1876325050615424:12345-0@lo:101: Request processed in 109us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403092.741189:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403092.741264:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af99d4de pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615424:0@lo:101: 00010000:00010000:2.0:1789403092.741278:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.741286:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403092.741364:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615552:0@lo:501: 00000100:00100000:2.0:1789403092.741412:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403092.741707:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 000000003377ce0d going to sleep for 11 seconds 00000100:00100000:1.0:1789403092.741775:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615552 00000100:00100000:1.0:1789403092.741780:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615552 00000100:00100000:1.0:1789403092.741802:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403092.741808:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008dec334a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6477:x1876325050615552:12345-0@lo:501: 00000100:00100000:1.0:1789403092.741984:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008dec334a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6477:x1876325050615552:12345-0@lo:501: Request processed in 175us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403092.741991:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789403092.742146:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615552:0@lo:501: 00000100:00100000:2.0:1789403092.742191:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615680:0@lo:503: 00000100:00100000:2.0:1789403092.742239:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403092.742266:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 000000003377ce0d going to sleep for 11 seconds 00000100:00100000:1.0:1789403092.742360:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615680 00000100:00100000:1.0:1789403092.742365:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615680 00000100:00100000:1.0:1789403092.742381:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403092.742386:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f457ab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6477:x1876325050615680:12345-0@lo:503: 00000040:00080000:1.0:1789403092.742463:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789403092.742494:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f457ab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6477:x1876325050615680:12345-0@lo:503: Request processed in 109us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403092.742500:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403092.742639:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615680:0@lo:503: 00000040:00080000:2.0:1789403092.743690:0:6525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789403092.744023:0:6477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789403092.744046:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403092.744104:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.744116:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403092.744171:0:6477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789403092.744175:0:6477:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a244ea0000 10000000:01000000:1.0:1789403092.744178:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a244ea0000 10000000:01000000:1.0:1789403092.744183:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403092.744189:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a244ea0000 from 1 10000000:01000000:1.0:1789403092.744204:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403092.744305:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.744314:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.744323:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.744342:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615808:0@lo:101: 00000100:00100000:1.0:1789403092.744674:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.744749:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013f4b31d going to sleep for 11 seconds 00000100:00100000:2.0:1789403092.744831:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615808 00000100:00100000:2.0:1789403092.744838:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615808 00000100:00100000:2.0:1789403092.744968:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403092.744978:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b05e491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6477:x1876325050615808:12345-0@lo:101: 00010000:00010000:2.0:1789403092.744992:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403092.745006:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760758 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.745029:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.745038:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.745045:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000723f05bd, rc 0) 00000100:00100000:2.0:1789403092.745088:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b05e491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050615808:12345-0@lo:101: Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403092.745094:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403092.745160:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615808:0@lo:101: 00010000:00010000:1.0:1789403092.745175:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.745183:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.745247:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615936:0@lo:501: 00000100:00100000:1.0:1789403092.745273:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.745560:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013f4b31d going to sleep for 11 seconds 00000100:00100000:0.0:1789403092.745691:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050615936 00000100:00100000:0.0:1789403092.745696:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050615936 00000100:00100000:0.0:1789403092.745721:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789403092.745727:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d86f3636 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050615936:12345-0@lo:501: 00000100:00100000:0.0:1789403092.745868:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d86f3636 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050615936:12345-0@lo:501: Request processed in 141us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403092.745875:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403092.746003:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050615936:0@lo:501: 00000100:00100000:1.0:1789403092.746034:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050616064:0@lo:503: 00000100:00100000:1.0:1789403092.746082:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.746101:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013f4b31d going to sleep for 11 seconds 00000100:00100000:0.0:1789403092.746343:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616064 00000100:00100000:0.0:1789403092.746348:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616064 00000100:00100000:0.0:1789403092.746373:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403092.746379:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f20a1583 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050616064:12345-0@lo:503: 00000100:00100000:1.0:1789403092.746697:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f20a1583 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050616064:12345-0@lo:503: Request processed in 317us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403092.746710:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403092.746780:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050616064:0@lo:503: 00000100:00100000:0.0:1789403092.747298:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e30f1186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6526:1876325050616192:0@lo:502: 00000100:00100000:0.0:1789403092.747339:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403092.747375:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041f573b1 going to sleep for 11 seconds 00000100:00100000:1.0:1789403092.747524:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616192 00000100:00100000:1.0:1789403092.747557:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616192 00000100:00100000:1.0:1789403092.747581:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403092.747586:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cce3d5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6526:x1876325050616192:12345-0@lo:502: 00000100:00100000:1.0:1789403092.747669:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cce3d5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6526:x1876325050616192:12345-0@lo:502: Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403092.747676:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789403092.747744:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e30f1186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6526:1876325050616192:0@lo:502: 00000020:01000004:0.0:1789403092.747799:0:6526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789403092.747826:0:6526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e14896e5) 00000020:00000080:0.0:1789403092.747851:0:6526:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789403092.748040:0:6526:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b59a5b14 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789403092.748044:0:6526:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b59a5b14 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789403092.748047:0:6526:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b59a5b14 4 00010000:00080000:0.0:1789403092.748077:0:6526:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005cb0e129@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403092.752147:0:6526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789403092.752673:0:6526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789403092.752720:0:6526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789403092.752734:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb08b1e5b76076d 00000100:00080000:1.0:1789403092.752745:0:6526:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403092.752758:0:6526:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005cb0e129 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403092.752793:0:6526:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006023ab2c x1876325050616320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403092.752855:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006023ab2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050616320:0@lo:38: 00000100:00100000:3.0:1789403092.752987:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403092.753043:0:6526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789403092.753323:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6322310 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6526:1876325050616448:0@lo:502: 00000100:00100000:1.0:1789403092.753366:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.753400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616448 00000100:00100000:1.0:1789403092.753408:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616448 00000100:00100000:1.0:1789403092.753558:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403092.753567:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009fe32cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6526:x1876325050616448:12345-0@lo:502: 00000100:00100000:1.0:1789403092.753674:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009fe32cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6526:x1876325050616448:12345-0@lo:502: Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403092.753681:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403092.753742:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f93af23d going to sleep for 11 seconds 00000100:00100000:1.0:1789403092.753762:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6322310 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6526:1876325050616448:0@lo:502: 00000040:00080000:1.0:1789403092.753787:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789403092.753838:0:6477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789403092.753861:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403092.753875:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.753885:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789403092.754074:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789403092.754077:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403092.754078:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403092.754080:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403092.754081:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403092.754083:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403092.754085:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403092.754086:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403092.754087:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403092.754089:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403092.754090:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403092.754091:0:6477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403092.754096:0:6477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789403092.754099:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403092.754101:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403092.754102:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403092.754103:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403092.754104:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403092.754105:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403092.754106:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403092.754107:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403092.754107:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403092.754108:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403092.754109:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403092.754110:0:6477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403092.754127:0:6477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789403092.754136:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6322310 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050616576:0@lo:253: 00000100:00100000:1.0:1789403092.754165:0:6477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.754216:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f93af23d going to sleep for 11 seconds 00000100:00100000:1.0:1789403092.754599:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616320 00000100:00100000:1.0:1789403092.754605:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616320 00000100:00100000:1.0:1789403092.754635:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403092.754640:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ef19fb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050616320:12345-0@lo:38: 00000100:00100000:1.0:1789403092.754698:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ef19fb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050616320:12345-0@lo:38: Request processed in 56us (1711us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789403092.754704:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403092.754930:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403092.754938:0:3625:0:(import.c:65:import_set_state_nolock()) 000000005cb0e129 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403092.754942:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789403092.754945:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006023ab2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050616320:0@lo:38: 00000100:00100000:3.0:1789403092.755095:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616576 00000100:00100000:3.0:1789403092.755100:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616576 00000100:00100000:3.0:1789403092.755132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403092.755137:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d048cc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050616576:12345-0@lo:253: 20000000:01000000:3.0:1789403092.755159:0:6495:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789403092.755172:0:6495:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789403092.765341:0:6495:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789403092.765423:0:6495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789403092.765938:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d048cc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6477:x1876325050616576:12345-0@lo:253: Request processed in 10795us (11767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403092.765951:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403092.766109:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6322310 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6477:1876325050616576:0@lo:253: 10000000:01000000:2.0:1789403092.766126:0:6477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789403092.766145:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789403092.766147:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789403092.766149:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403092.766150:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403092.766152:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403092.766153:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403092.766154:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403092.766156:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789403092.766157:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789403092.766158:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789403092.766160:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403092.766161:0:6477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789403092.766176:0:6477:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789403092.769850:0:6515:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789403092.769862:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789403092.770256:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.770280:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.770288:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.770334:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.770355:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 11 pid: 6492 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.770370:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8a6324a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050616704:0@lo:104: 00000100:00100000:1.0:1789403092.771453:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403092.771548:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5b4dda2 going to sleep for 11 seconds 00000100:00100000:0.0:1789403092.772535:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616704 00000100:00100000:0.0:1789403092.772547:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616704 00000100:00100000:0.0:1789403092.772602:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403092.773354:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004ac18a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050616704:12345-0@lo:104: 00010000:00010000:0.0:1789403092.773374:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403092.773581:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789403092.773587:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004ac18a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050616704:12345-0@lo:104: Request processed in 240us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403092.773594:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789403092.773978:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403092.773986:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.773994:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000dbb83f8 already unused, calling callback (000000002e5bd7ad) 10000000:00010000:3.0:1789403092.773998:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.774006:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403092.774013:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403092.774019:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403092.774060:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.774066:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403092.774087:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.774093:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 000000000dbb83f8/0x5fb08b1e5b76073c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760743 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403092.774111:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403092.774124:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403092.774126:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403092.774830:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8fc49b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050616832:0@lo:103: 00000100:00100000:3.0:1789403092.775027:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8a6324a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050616704:0@lo:104: 00010000:00010000:3.0:1789403092.775053:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403092.775291:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1789403092.776073:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789403092.776276:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789403092.776546:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789403092.776712:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789403092.776933:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789403092.777069:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1789403092.780816:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616832 00000100:00100000:1.0:1789403092.780833:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616832 00010000:00010000:1.0:1789403092.780874:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 12 pid: 6492 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.780919:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403092.780928:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e30f1186 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3627:x1876325050616832:12345-0@lo:103: 00010000:00010000:1.0:1789403092.780941:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403092.780946:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 12 pid: 6492 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.780958:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 12 pid: 6492 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.780978:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76073c expref: 12 pid: 6492 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.780997:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781007:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789403092.781026:0:6485:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011165521s 00010000:00010000:1.0:1789403092.781030:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781038:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781044:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781070:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781076:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bbefa25d already unused, calling callback (0000000042c3b639) 00010000:00010000:1.0:1789403092.781080:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781088:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781112:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403092.781124:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403092.781220:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e30f1186 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:3627:x1876325050616832:12345-0@lo:103: Request processed in 293us (6328us total) trans 0 rc 0/0 00010000:00010000:2.0:1789403092.781414:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.781424:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403092.781429:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b760774 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403092.781621:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403092.781792:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8fc49b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050616832:0@lo:103: 00080000:10000000:2.0:1789403092.796621:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789403092.796816:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789403092.797038:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789403092.797199:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789403092.797435:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789403092.797608:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789403092.803298:0:6477:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789403092.819731:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789403092.820087:0:6532:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789403092.822130:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:0.0:1789403092.822987:0:6531:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789403092.822994:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789403092.823303:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789403092.824358:0:6477:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789403092.824375:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789403092.824774:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403092.827998:0:6477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789403092.828858:0:6477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789403092.828896:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789403092.829722:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789403092.830035:0:6477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1789403092.831032:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789403092.831176:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789403092.831484:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789403092.831631:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789403092.831777:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789403092.832202:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789403092.832377:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789403092.832665:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789403092.832796:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789403092.833093:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789403092.833526:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789403092.833710:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789403092.833843:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789403092.834057:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000040:00080000:2.0:1789403092.834069:0:6532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1789403092.834562:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789403092.837742:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789403092.838619:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789403092.838819:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789403092.839047:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789403092.839190:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789403092.839336:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789403092.839647:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789403092.839780:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789403092.840722:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789403092.841262:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789403092.841476:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789403092.842312:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789403092.842744:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789403092.842892:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789403092.843052:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789403092.843301:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789403092.843435:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789403092.843645:0:6477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789403092.847788:0:6477:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789403092.847840:0:6477:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb21c167b988 00100000:10000000:1.0:1789403092.847849:0:6477:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789403092.848706:0:6477:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789403092.848725:0:6477:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789403092.848744:0:6477:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789403092.848765:0:6477:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789403092.849695:0:6477:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403092.849914:0:6477:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1789403092.852004:0:6532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789403092.852094:0:6532:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789403092.852099:0:6532:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789403093.494817:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403094.513567:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403095.537924:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789403096.411597:0:6777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789403096.562897:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403097.587367:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789403097.685382:0:6829:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403097.685678:0:6829:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789403097.849927:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e72e044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050616960:0@lo:400: 00000100:00100000:0.0:1789403097.850018:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789403097.850323:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789403097.850328:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789403097.850331:0:36:0:(import.c:65:import_set_state_nolock()) 000000005cb0e129 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403097.850344:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005cb0e129 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403097.850369:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000025a6d018 x1876325050617088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403097.850422:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050617088:0@lo:38: 00000100:00100000:3.0:1789403097.850456:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403097.850536:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050616960 00000100:00100000:3.0:1789403097.850543:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050616960 00000100:00100000:3.0:1789403097.850586:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403097.850593:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e0df53b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:3628:x1876325050616960:12345-0@lo:400: 00000100:00100000:1.0:1789403097.851318:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617088 00000100:00100000:1.0:1789403097.851325:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617088 00000100:00100000:1.0:1789403097.851355:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403097.851360:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a6692ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050617088:12345-0@lo:38: 00010000:00080000:1.0:1789403097.851382:0:6501:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:1.0:1789403097.851438:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb08b1e5b76077b 00000004:00100000:1.0:1789403097.851504:0:6501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403097.851617:0:6501:0:(import.c:65:import_set_state_nolock()) 00000000f570858c : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403097.851672:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a6692ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876325050617088:12345-0@lo:38: Request processed in 310us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403097.851680:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403097.855462:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e0df53b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:3628:x1876325050616960:12345-0@lo:400: Request processed in 4858us (5433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403097.855486:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789403097.855601:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000025a6d018 x1876325050617088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403097.855624:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789403097.855636:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789403097.855641:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789403097.855645:0:3625:0:(import.c:65:import_set_state_nolock()) 000000005cb0e129 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789403097.855652:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050617088:0@lo:38: 00000100:00100000:0.0:1789403097.858661:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e72e044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050616960:0@lo:400: 00010000:00010000:3.0:1789403098.610371:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403099.633640:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403100.657868:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789403101.334497:0:6931:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403101.334823:0:6931:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789403101.425559:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789403101.425576:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a244ea0000 from 3 10000000:01000000:3.0:1789403101.425581:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403101.425624:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403101.425701:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403101.425712:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403101.425735:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050617216:0@lo:101: 00000100:00100000:3.0:1789403101.425797:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403101.425846:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a5c8c2a going to sleep for 11 seconds 00000100:00100000:0.0:1789403101.425894:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617216 00000100:00100000:0.0:1789403101.425911:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617216 00000100:00100000:0.0:1789403101.425958:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403101.425966:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4069c40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:6497:x1876325050617216:12345-0@lo:101: 00010000:00010000:0.0:1789403101.425977:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403101.425988:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760782 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403101.426007:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403101.426017:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403101.426025:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd551bfd, rc 0) 00000100:00100000:0.0:1789403101.426069:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4069c40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6497:x1876325050617216:12345-0@lo:101: Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403101.426075:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403101.426145:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050617216:0@lo:101: 00010000:00010000:2.0:1789403101.426168:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403101.426177:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403101.426229:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050617344:0@lo:256: 00000100:00100000:2.0:1789403101.426259:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403101.426286:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018309f79 going to sleep for 11 seconds 00000100:00100000:0.0:1789403101.426877:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617344 00000100:00100000:0.0:1789403101.426883:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617344 00000100:00100000:0.0:1789403101.426919:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789403101.426932:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001812bab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6497:x1876325050617344:12345-0@lo:256: 20000000:01000000:0.0:1789403101.426947:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789403101.426960:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789403101.426963:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789403101.427034:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001812bab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:6497:x1876325050617344:12345-0@lo:256: Request processed in 103us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403101.427041:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403101.427610:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050617344:0@lo:256: 10000000:01000000:2.0:1789403101.427728:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789403101.427735:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403101.427755:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403101.682210:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403102.705973:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403102.962494:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050617600:0@lo:400: 00000100:00100000:2.0:1789403102.962599:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403102.962686:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617600 00000100:00100000:2.0:1789403102.962693:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617600 00000100:00100000:2.0:1789403102.962739:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403102.962747:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9060d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050617600:12345-0@lo:400: 00000100:00100000:2.0:1789403102.962795:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9060d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050617600:12345-0@lo:400: Request processed in 49us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403102.962802:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789403102.962843:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c9c2332e x1876325050617600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403102.962857:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050617600:0@lo:400: 00000100:00100000:0.0:1789403102.963498:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050617472:0@lo:400: 00000100:00100000:0.0:1789403102.963549:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403102.974950:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617472 00000100:00100000:2.0:1789403102.974964:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617472 00000100:00100000:2.0:1789403102.975090:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789403102.975099:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d3ee77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3629:x1876325050617472:12345-0@lo:400: 00000100:00100000:2.0:1789403102.975199:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d3ee77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3629:x1876325050617472:12345-0@lo:400: Request processed in 102us (11650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403102.975207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789403102.976237:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000969f17b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050617472:0@lo:400: 00010000:00010000:3.0:1789403103.737609:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403104.754475:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403105.777933:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403106.804508:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403107.829269:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403108.083838:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7011b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050617728:0@lo:400: 00000100:00100000:0.0:1789403108.083916:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403108.084060:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403108.084081:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050617856:0@lo:400: 00000100:00100000:0.0:1789403108.084141:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403108.084225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617728 00000100:00100000:0.0:1789403108.084232:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617728 00000100:00100000:0.0:1789403108.084382:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403108.084490:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db3bf453 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3627:x1876325050617728:12345-0@lo:400: 00000100:00100000:0.0:1789403108.085083:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db3bf453 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3627:x1876325050617728:12345-0@lo:400: Request processed in 694us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403108.085091:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403108.085131:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617856 00000100:00100000:0.0:1789403108.085135:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617856 00000100:00100000:0.0:1789403108.085160:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403108.085165:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d29a6c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050617856:12345-0@lo:400: 00000100:00100000:0.0:1789403108.085205:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d29a6c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050617856:12345-0@lo:400: Request processed in 40us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403108.085211:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403108.085365:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000ecdc299 x1876325050617856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403108.085379:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050617856:0@lo:400: 00000100:00100000:0.0:1789403108.085436:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7011b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050617728:0@lo:400: 00010000:00010000:1.0:1789403108.855894:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403109.873653:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403110.898786:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403111.923303:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403112.953699:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403113.209116:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bef77b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050618112:0@lo:400: 00000100:00100000:2.0:1789403113.209207:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403113.209281:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618112 00000100:00100000:2.0:1789403113.209288:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618112 00000100:00100000:2.0:1789403113.209342:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403113.209350:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d865634b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050618112:12345-0@lo:400: 00000100:00100000:2.0:1789403113.209431:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d865634b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050618112:12345-0@lo:400: Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403113.209438:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789403113.209476:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bef77b6f x1876325050618112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403113.209490:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bef77b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050618112:0@lo:400: 00000100:00100000:1.0:1789403113.209743:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403113.209763:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050617984:0@lo:400: 00000100:00100000:1.0:1789403113.209798:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403113.213194:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050617984 00000100:00100000:2.0:1789403113.213209:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050617984 00000100:00100000:2.0:1789403113.213279:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789403113.213288:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043d9ac51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3628:x1876325050617984:12345-0@lo:400: 00000100:00100000:2.0:1789403113.213414:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043d9ac51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:3628:x1876325050617984:12345-0@lo:400: Request processed in 127us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403113.213420:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789403113.213476:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050617984:0@lo:400: 00010000:00010000:0.0:1789403113.978851:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789403114.892148:0:7429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789403114.892152:0:7429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789403114.892154:0:7429:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789403114.892299:0:7429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000073d8681c 00000020:01000004:0.0:1789403114.892313:0:7429:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789403114.892323:0:7429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789403114.892335:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000043e16da9) 00000020:00000080:0.0:1789403114.895157:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789403114.993694:0:7429:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789403114.993792:0:7429:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00010000:00010000:2.0:1789403115.001558:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:2.0:1789403115.041702:0:7429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789403115.041956:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789403115.041966:0:7429:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789403115.041976:0:7429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b760797 00000020:01000004:2.0:1789403115.041983:0:7429:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789403115.042003:0:7429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789403115.042007:0:7429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789403115.042018:0:7429:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789403115.042045:0:7429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789403115.042050:0:7429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789403115.125831:0:7429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789403115.125871:0:7429:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789403115.125876:0:7429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789403115.125878:0:7429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789403115.125879:0:7429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403115.125880:0:7429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403115.125882:0:7429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403115.125883:0:7429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403115.125884:0:7429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403115.125885:0:7429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789403115.125887:0:7429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789403115.125888:0:7429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403115.125889:0:7429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789403115.125893:0:7429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789403115.125895:0:7429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789403115.125897:0:7429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789403115.125898:0:7429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403115.125899:0:7429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403115.125900:0:7429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403115.125901:0:7429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403115.125902:0:7429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403115.125903:0:7429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789403115.125904:0:7429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789403115.125904:0:7429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403115.125905:0:7429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789403115.125930:0:7429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789403115.125947:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050618240:0@lo:253: 00000100:00100000:2.0:1789403115.126017:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.126060:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d98e48e going to sleep for 11 seconds 00000100:00100000:0.0:1789403115.126153:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618240 00000100:00100000:0.0:1789403115.126160:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618240 00000100:00100000:0.0:1789403115.126209:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789403115.126217:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008fd40dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050618240:12345-0@lo:253: 20000000:01000000:0.0:1789403115.126245:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789403115.126249:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789403115.126253:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789403115.126256:0:6492:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789403115.126286:0:6492:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789403115.126499:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403115.126641:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789403115.126654:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789403115.126678:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789403115.126695:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789403115.126708:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789403115.126758:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789403115.126766:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789403115.126779:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789403115.126784:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789403115.126796:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789403115.126801:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789403115.126814:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789403115.126828:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789403115.126931:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789403115.126941:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789403115.126955:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789403115.126962:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789403115.126975:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789403115.126982:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1789403115.126995:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789403115.127001:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789403115.127013:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789403115.127041:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789403115.127053:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789403115.127129:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789403115.127138:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789403115.127150:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789403115.127165:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789403115.127179:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789403115.127185:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789403115.127196:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789403115.127216:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789403115.127228:0:6492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789403115.127249:0:6492:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789403115.127256:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789403115.129002:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789403115.129358:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789403115.129385:0:6492:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.143@tcp for mdt 20000000:01000000:0.0:1789403115.129420:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789403115.129438:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789403115.129444:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789403115.129468:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789403115.129474:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1789403115.129490:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789403115.129497:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789403115.129511:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789403115.129525:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789403115.129583:0:6492:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789403115.129591:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789403115.130293:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789403115.130833:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789403115.130853:0:6492:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.143@tcp for mdt 20000000:01000000:2.0:1789403115.130855:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:2.0:1789403115.130869:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789403115.130883:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789403115.130907:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789403115.130914:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:2.0:1789403115.130927:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789403115.130933:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789403115.130944:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789403115.130958:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789403115.130979:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789403115.130982:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789403115.130985:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789403115.131033:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789403115.131035:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789403115.131810:0:7437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789403115.131830:0:7437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789403115.131844:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789403115.131989:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789403115.132006:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789403115.132019:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789403115.132030:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789403115.132031:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789403115.132939:0:7438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789403115.132966:0:7438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789403115.132980:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789403115.134300:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789403115.134327:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789403115.134355:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789403115.134366:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789403115.134368:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789403115.135016:0:7439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789403115.135035:0:7439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789403115.135049:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789403115.135369:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789403115.135851:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789403115.135884:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789403115.135900:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789403115.135902:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789403115.135907:0:6492:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789403115.135913:0:6492:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789403115.136358:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789403115.136809:0:6492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789403115.155451:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789403115.156424:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156446:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156453:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156460:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156466:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156508:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156524:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 12 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.156547:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050618368:0@lo:104: 00000100:00100000:3.0:1789403115.156604:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403115.156768:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156776:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 12 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.156802:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb8e52aa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050618496:0@lo:104: 00000100:00100000:3.0:1789403115.156826:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403115.156855:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.156862:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 12 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.156869:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f25af949 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050618624:0@lo:104: 00000100:00100000:3.0:1789403115.156888:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.156898:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006e35169 going to sleep for 11 seconds 00000100:00100000:2.0:1789403115.157003:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618368 00000100:00100000:2.0:1789403115.157010:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618368 00000100:00100000:2.0:1789403115.157405:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618496 00000100:00100000:2.0:1789403115.157410:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618496 00000100:00100000:1.0:1789403115.157858:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618624 00000100:00100000:1.0:1789403115.157863:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618624 00000100:00100000:1.0:1789403115.157888:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403115.157895:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0560a02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6492:x1876325050618368:12345-0@lo:104: 00010000:00010000:1.0:1789403115.157907:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.157976:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403115.157981:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0560a02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6492:x1876325050618368:12345-0@lo:104: Request processed in 88us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.157988:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403115.158005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403115.158010:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e08b7d74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6492:x1876325050618496:12345-0@lo:104: 00010000:00010000:1.0:1789403115.158016:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.158047:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789403115.158061:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e08b7d74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6492:x1876325050618496:12345-0@lo:104: Request processed in 42us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.158067:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403115.158080:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403115.158085:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006428a8be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050618624:12345-0@lo:104: 00010000:00010000:1.0:1789403115.158092:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.158118:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789403115.158122:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006428a8be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050618624:12345-0@lo:104: Request processed in 38us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.158134:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789403115.158261:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789403115.158267:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158280:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067b1e49a already unused, calling callback (000000002e5bd7ad) 10000000:00010000:0.0:1789403115.158283:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158290:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403115.158297:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.158302:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403115.158328:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158333:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403115.158361:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158367:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 0000000067b1e49a/0x5fb08b1e5b760758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76075f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158381:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403115.158383:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158411:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000146ac786 already unused, calling callback (000000002e5bd7ad) 10000000:00010000:0.0:1789403115.158414:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158429:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403115.158434:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.158439:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403115.158450:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158456:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403115.158469:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158475:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 00000000146ac786/0x5fb08b1e5b7606e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7606ef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158484:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403115.158486:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158492:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000585b3603 already unused, calling callback (000000002e5bd7ad) 10000000:00010000:0.0:1789403115.158493:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158499:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403115.158504:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.158514:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403115.158524:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158541:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403115.158545:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158551:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 00000000585b3603/0x5fb08b1e5b7606cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7606d3 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158570:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403115.158571:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403115.158573:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403115.158585:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7011b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050618752:0@lo:103: 00000100:00100000:0.0:1789403115.158616:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.158765:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050618880:0@lo:103: 00000100:00100000:0.0:1789403115.158789:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.158805:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403115.158810:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050619008:0@lo:103: 00000100:00100000:0.0:1789403115.158843:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.158866:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618752 00000100:00100000:0.0:1789403115.158871:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618752 00010000:00010000:0.0:1789403115.158891:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 13 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.158905:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050618880 00000100:00100000:0.0:1789403115.158908:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050618880 00010000:00010000:0.0:1789403115.158927:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 14 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.158938:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619008 00000100:00100000:0.0:1789403115.158940:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619008 00010000:00010000:0.0:1789403115.158949:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 15 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.158961:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403115.158966:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bc91694 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3627:x1876325050618752:12345-0@lo:103: 00010000:00010000:0.0:1789403115.158974:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403115.158978:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 15 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158986:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 15 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.158999:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403115.159023:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bc91694 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3627:x1876325050618752:12345-0@lo:103: Request processed in 58us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.159029:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403115.159041:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403115.159046:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb0bf22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:3628:x1876325050618880:12345-0@lo:103: 00010000:00010000:0.0:1789403115.159065:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403115.159068:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 14 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159075:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 14 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159094:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403115.159119:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb0bf22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:3628:x1876325050618880:12345-0@lo:103: Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.159125:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403115.159138:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403115.159210:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba12a846 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:3628:x1876325050619008:12345-0@lo:103: 00010000:00010000:0.0:1789403115.159217:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403115.159220:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 13 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159227:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 13 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159237:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159243:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159256:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159262:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159266:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159272:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159282:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ef76ce4 already unused, calling callback (0000000042c3b639) 00010000:00010000:0.0:1789403115.159285:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159292:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159300:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.159309:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403115.159341:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba12a846 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:3628:x1876325050619008:12345-0@lo:103: Request processed in 134us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.159357:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403115.159419:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7011b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050618752:0@lo:103: 00000100:00100000:0.0:1789403115.159443:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050619008:0@lo:103: 00000100:00100000:0.0:1789403115.159453:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050618880:0@lo:103: 00010000:00010000:3.0:1789403115.159557:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000723f05bd/0x5fb08b1e5b76075f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760758 expref: 12 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.159568:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050618368:0@lo:104: 00010000:00010000:3.0:1789403115.159574:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000027f777b/0x5fb08b1e5b7606ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7606e8 expref: 11 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.159580:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb8e52aa pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050618496:0@lo:104: 00010000:00010000:3.0:1789403115.159586:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026e19e37/0x5fb08b1e5b7606d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7606cc expref: 10 pid: 6493 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.159592:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f25af949 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050618624:0@lo:104: 00010000:00010000:3.0:1789403115.159605:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.159613:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.159625:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.159639:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b76079e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789403115.159656:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:2.0:1789403115.162523:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403115.162806:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008fd40dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:7429:x1876325050618240:12345-0@lo:253: Request processed in 36586us (36786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.162819:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789403115.162888:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050618240:0@lo:253: 10000000:01000000:2.0:1789403115.162903:0:7429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789403115.162906:0:7429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789403115.162908:0:7429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789403115.162910:0:7429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403115.162911:0:7429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789403115.162912:0:7429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403115.162913:0:7429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403115.162914:0:7429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403115.162916:0:7429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789403115.162917:0:7429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403115.162918:0:7429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789403115.162937:0:7429:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000073d8681c from lustre-MDT0001 10000000:01000000:2.0:1789403115.162965:0:7429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789403115.162968:0:7429:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789403115.162975:0:7429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a245c9b380 local copy 10000000:01000000:2.0:1789403115.162979:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789403115.163011:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.163020:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.163028:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403115.163045:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619136:0@lo:101: 00000100:00100000:2.0:1789403115.163204:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.163279:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007f6ed9c going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.163313:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619136 00000100:00100000:1.0:1789403115.163321:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619136 00000100:00100000:1.0:1789403115.163506:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403115.163514:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c0c6868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:7429:x1876325050619136:12345-0@lo:101: 00010000:00010000:1.0:1789403115.163591:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403115.163604:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b7607ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7607a5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.163626:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b7607ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607a5 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.163695:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b7607ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607a5 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.163704:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a7148a3, rc 0) 00000100:00100000:1.0:1789403115.163777:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c0c6868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:7429:x1876325050619136:12345-0@lo:101: Request processed in 264us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.163783:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789403115.163829:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9c2332e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619136:0@lo:101: 00010000:00010000:0.0:1789403115.163841:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.163849:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.163934:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619264:0@lo:501: 00000100:00100000:0.0:1789403115.163959:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.164152:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e0459f2 going to sleep for 11 seconds 00000100:00100000:2.0:1789403115.164312:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619264 00000100:00100000:2.0:1789403115.164323:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619264 00000100:00100000:2.0:1789403115.164464:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403115.164470:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008fac33f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:7429:x1876325050619264:12345-0@lo:501: 00000100:00100000:2.0:1789403115.164524:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008fac33f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:7429:x1876325050619264:12345-0@lo:501: Request processed in 55us (564us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789403115.164600:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789403115.164857:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619264:0@lo:501: 10000000:01000000:0.0:1789403115.164872:0:7429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789403115.164890:0:7429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789403115.164895:0:7429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.164902:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.164908:0:7429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.164932:0:7429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789403115.164957:0:7429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a281b11800 10000000:01000000:0.0:1789403115.164961:0:7429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789403115.164965:0:7429:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a245c9b380 10000000:01000000:0.0:1789403115.164967:0:7429:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789403115.164970:0:7429:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a245c9b380 from 1 10000000:01000000:0.0:1789403115.164973:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789403115.164991:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.164998:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.165006:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.165018:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619392:0@lo:101: 00010000:00010000:1.0:1789403115.165522:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403115.165587:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.165596:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ebeefd75 already unused, calling callback (000000002e5bd7ad) 10000000:00010000:1.0:1789403115.165599:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.165606:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403115.165624:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403115.165629:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403115.165703:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.165710:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789403115.165759:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050619520:0@lo:103: 00000100:00100000:2.0:1789403115.165792:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.165858:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619520 00000100:00100000:3.0:1789403115.165864:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619520 00000100:00100000:3.0:1789403115.165902:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403115.165909:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bef77b6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:3626:x1876325050619520:12345-0@lo:103: 00010000:00010000:3.0:1789403115.165919:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403115.165930:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b7607ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b7607a5 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.165945:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403115.166011:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.166026:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00010000:00010000:1.0:1789403115.166071:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.166080:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 00000000ebeefd75/0x5fb08b1e5b7607a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b7607ac expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.166092:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403115.166094:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403115.166095:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403115.170177:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bef77b6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:3626:x1876325050619520:12345-0@lo:103: Request processed in 4259us (4375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.170193:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403115.170335:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050619520:0@lo:103: 00000100:00100000:2.0:1789403115.170376:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619392 00000100:00100000:2.0:1789403115.170382:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619392 00000100:00100000:3.0:1789403115.170693:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403115.170701:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064eeff85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:7429:x1876325050619392:12345-0@lo:101: 00010000:00010000:3.0:1789403115.170716:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403115.170733:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b7607ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7607b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.170775:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b7607ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607b3 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.170785:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ef76ce4/0x5fb08b1e5b7607ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607b3 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.170794:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ef76ce4, rc 0) 00000100:00100000:3.0:1789403115.170851:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064eeff85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:7429:x1876325050619392:12345-0@lo:101: Request processed in 152us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.170858:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789403115.170917:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619392:0@lo:101: 00010000:00010000:0.0:1789403115.170932:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.170941:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.170959:0:7429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789403115.170979:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.170987:0:7429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000054060a62/0x5fb08b1e5b7607b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.170998:0:7429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a281b11800 10000000:01000000:0.0:1789403115.171003:0:7429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789403115.171007:0:7429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a281b11800 from 1 10000000:01000000:0.0:1789403115.171010:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789403115.171030:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171036:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171043:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.171067:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619648:0@lo:101: 00000100:00100000:0.0:1789403115.171104:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.171267:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.171334:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619648 00000100:00100000:1.0:1789403115.171339:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619648 00000100:00100000:1.0:1789403115.171373:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789403115.171378:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b72fe0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+10:7429:x1876325050619648:12345-0@lo:101: 00010000:00010000:1.0:1789403115.171385:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403115.171421:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b7607c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7607c1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.171436:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b7607c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607c1 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.171442:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbefa25d/0x5fb08b1e5b7607c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607c1 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.171455:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbefa25d, rc 0) 00000100:00100000:1.0:1789403115.171483:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b72fe0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:7429:x1876325050619648:12345-0@lo:101: Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.171489:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789403115.171558:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619648:0@lo:101: 00010000:00010000:0.0:1789403115.171568:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171574:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.171584:0:7429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789403115.171598:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171604:0:7429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000018c30f88/0x5fb08b1e5b7607c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.171610:0:7429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789403115.171613:0:7429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789403115.171617:0:7429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a281b11800 10000000:01000000:0.0:1789403115.171619:0:7429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789403115.171621:0:7429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789403115.171623:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789403115.171635:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171642:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171649:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.171667:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619776:0@lo:101: 00000100:00100000:0.0:1789403115.171690:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.171705:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.171757:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619776 00000100:00100000:1.0:1789403115.171761:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619776 00000100:00100000:1.0:1789403115.171778:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789403115.171784:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d3799e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+11:7429:x1876325050619776:12345-0@lo:101: 00010000:00010000:1.0:1789403115.171790:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403115.171798:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000dbb83f8/0x5fb08b1e5b7607d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7607cf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.171809:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000dbb83f8/0x5fb08b1e5b7607d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.171816:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000dbb83f8/0x5fb08b1e5b7607d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.171822:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000dbb83f8, rc 0) 00000100:00100000:1.0:1789403115.171853:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d3799e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050619776:12345-0@lo:101: Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.171859:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789403115.171919:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619776:0@lo:101: 00010000:00010000:0.0:1789403115.171929:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.171935:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.172018:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619904:0@lo:501: 00000100:00100000:0.0:1789403115.172042:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.172069:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.172162:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050619904 00000100:00100000:1.0:1789403115.172166:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050619904 00000100:00100000:1.0:1789403115.172182:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789403115.172187:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003af47532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050619904:12345-0@lo:501: 00000100:00100000:1.0:1789403115.172288:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003af47532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050619904:12345-0@lo:501: Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.172301:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789403115.172375:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050619904:0@lo:501: 00000100:00100000:0.0:1789403115.172428:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620032:0@lo:503: 00000100:00100000:0.0:1789403115.172465:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.172479:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.172548:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620032 00000100:00100000:1.0:1789403115.172552:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620032 00000100:00100000:1.0:1789403115.172567:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789403115.172572:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c02bec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620032:12345-0@lo:503: 00000100:00100000:1.0:1789403115.172639:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c02bec84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620032:12345-0@lo:503: Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.172645:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789403115.172714:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620032:0@lo:503: 00000040:00080000:0.0:1789403115.172939:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403115.173007:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620160:0@lo:502: 00000100:00100000:0.0:1789403115.173038:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.173158:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00000100:00100000:3.0:1789403115.173223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620160 00000100:00100000:3.0:1789403115.173229:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620160 00000100:00100000:2.0:1789403115.173307:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403115.173316:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a801e86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620160:12345-0@lo:502: 00000100:00100000:2.0:1789403115.173419:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a801e86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620160:12345-0@lo:502: Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403115.173425:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789403115.173512:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620160:0@lo:502: 00000040:00080000:0.0:1789403115.173721:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789403115.173754:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789403115.173769:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789403115.173784:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789403115.173796:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789403115.173808:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789403115.173819:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789403115.173831:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789403115.173843:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789403115.173856:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789403115.173869:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789403115.173883:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789403115.173896:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789403115.173908:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789403115.173920:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789403115.173946:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789403115.173960:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789403115.173973:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789403115.173985:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789403115.173996:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789403115.174007:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789403115.174018:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789403115.174030:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789403115.174065:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620288:0@lo:502: 00000100:00100000:0.0:1789403115.174102:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.174948:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0ff721d going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.175024:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620288 00000100:00100000:1.0:1789403115.175031:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620288 00000100:00100000:1.0:1789403115.175129:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789403115.175137:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2dafe05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620288:12345-0@lo:502: 00000100:00100000:1.0:1789403115.175297:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2dafe05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620288:12345-0@lo:502: Request processed in 161us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.175304:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789403115.175417:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620288:0@lo:502: 00000040:00080000:0.0:1789403115.175475:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789403115.175484:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789403115.176015:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403115.176025:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.176027:0:7441:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789403115.176037:0:7441:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789403115.176040:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403115.176119:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000687307f0) 00000020:00000080:0.0:1789403115.176138:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789403115.176144:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789403115.176229:0:7441:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789403115.176236:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b7607e4 00000020:00000080:2.0:1789403115.176624:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789403115.176629:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403115.176633:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403115.176634:0:7441:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789403115.176638:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403115.176642:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403115.176643:0:7441:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789403115.176647:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403115.176654:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a3de91a9) 00000020:00000080:2.0:1789403115.176666:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789403115.176671:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789403115.176673:0:7441:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789403115.176675:0:7441:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789403115.176687:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789403115.176740:0:7441:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073d8681c from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789403115.176752:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000096c9b29f) 00000020:00000080:2.0:1789403115.176761:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789403115.176813:0:7441:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789403115.176818:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7607f9 00000020:00000080:2.0:1789403115.176906:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789403115.176913:0:7441:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789403115.176917:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5fb08b1e5b760800 00080000:01000000:2.0:1789403115.176922:0:7441:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789403115.176925:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b760807 00080000:10000000:2.0:1789403115.177359:0:7441:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789403115.177688:0:7441:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789403115.307528:0:7441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1789403115.307820:0:7441:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1789403115.318102:0:7441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789403115.318532:0:7441:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789403115.337248:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789403115.337261:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403115.337266:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403115.337269:0:7441:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789403115.337271:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403115.337277:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403115.337279:0:7441:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789403115.337293:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789403115.337299:0:7441:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:2.0:1789403115.337326:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403115.337339:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000053134c2) 00000020:00000080:2.0:1789403115.337367:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789403115.337373:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789403115.337457:0:7441:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789403115.337464:0:7441:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789403115.337470:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b760815 00010000:00080000:2.0:1789403115.337515:0:7441:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f3b5023e@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1789403115.346281:0:7441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1789403115.348848:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789403115.348862:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789403115.348900:0:7441:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789403115.348921:0:7441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b76081c 00000100:00080000:0.0:1789403115.348932:0:7441:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403115.349358:0:7441:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000f3b5023e using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403115.349472:0:7441:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ecdc299 x1876325050620416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403115.349532:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050620416:0@lo:38: 00000100:00100000:3.0:1789403115.349618:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403115.349727:0:7441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789403115.349791:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050620544:0@lo:400: 00000100:00100000:0.0:1789403115.349822:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.349861:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620544 00000100:00100000:0.0:1789403115.349868:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620544 00000100:00100000:0.0:1789403115.349907:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403115.349914:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e7011b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050620544:12345-0@lo:400: 00000100:00100000:0.0:1789403115.349974:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e7011b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050620544:12345-0@lo:400: Request processed in 60us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.349980:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789403115.350026:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000069e62506 x1876325050620544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403115.350039:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050620544:0@lo:400: 00000020:01000000:0.0:1789403115.350104:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403115.350108:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.350110:0:7441:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789403115.350113:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789403115.350116:0:7441:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789403115.350117:0:7441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403115.350118:0:7441:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403115.350120:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789403115.350121:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.350122:0:7441:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789403115.350124:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403115.350129:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.350130:0:7441:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789403115.350133:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789403115.350168:0:7441:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789403115.350181:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403115.350184:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.350185:0:7441:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789403115.350187:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403115.350190:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.350191:0:7441:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789403115.350193:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789403115.350195:0:7441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789403115.350220:0:7441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403115.350223:0:7441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403115.350225:0:7441:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789403115.350228:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1789403115.350277:0:7429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789403115.350663:0:7429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789403115.350683:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.350692:0:7429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000001c308510/0x5fb08b1e5b7607cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403115.350700:0:7429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b11800 from 1 10000000:01000000:0.0:1789403115.350703:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403115.350724:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.350731:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.350740:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.350758:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620672:0@lo:101: 00000100:00100000:0.0:1789403115.350788:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.350811:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000350f05d0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.351087:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620672 00000100:00100000:1.0:1789403115.351093:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620672 00000100:00100000:1.0:1789403115.351132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403115.351139:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e07994b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+12:7429:x1876325050620672:12345-0@lo:101: 00010000:00010000:1.0:1789403115.351149:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403115.351159:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760823 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.351177:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.351188:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.351202:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a7148a3, rc 0) 00000100:00100000:1.0:1789403115.351232:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e07994b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:7429:x1876325050620672:12345-0@lo:101: Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.351238:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403115.351444:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620672:0@lo:101: 00010000:00010000:0.0:1789403115.351456:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.351464:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.352139:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620800:0@lo:256: 00000100:00100000:0.0:1789403115.352180:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.353040:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000350f05d0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403115.353177:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620416 00000100:00100000:2.0:1789403115.353192:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620416 00000100:00100000:2.0:1789403115.353231:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403115.353237:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f25af949 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050620416:12345-0@lo:38: 00010000:00080000:2.0:1789403115.353261:0:6504:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1789403115.353324:0:6504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b760831 00000004:00100000:2.0:1789403115.353339:0:6504:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789403115.353355:0:6504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789403115.354486:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620800 00000100:00100000:1.0:1789403115.354494:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620800 00000100:00100000:1.0:1789403115.354537:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789403115.354545:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000edb60405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:7429:x1876325050620800:12345-0@lo:256: 20000000:01000000:1.0:1789403115.354565:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789403115.354581:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789403115.354584:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789403115.354691:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000edb60405 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:7429:x1876325050620800:12345-0@lo:256: Request processed in 147us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.354698:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789403115.355465:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069e62506 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620800:0@lo:256: 10000000:01000000:2.0:1789403115.356141:0:7429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789403115.356162:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.356173:0:7429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403115.356181:0:7429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b11800 from 1 10000000:01000000:2.0:1789403115.356184:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403115.356212:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.356219:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.356227:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403115.356245:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e69608ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620928:0@lo:101: 00000100:00100000:2.0:1789403115.356363:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.356496:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ebfc55b going to sleep for 11 seconds 00000100:00100000:3.0:1789403115.358381:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050620928 00000100:00100000:3.0:1789403115.358406:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050620928 00000100:00100000:3.0:1789403115.358449:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403115.358457:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004076b3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:7429:x1876325050620928:12345-0@lo:101: 00010000:00010000:3.0:1789403115.358474:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403115.358488:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760838 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.358513:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.358522:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.358541:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008652f954, rc 0) 00000100:00100000:3.0:1789403115.358600:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004076b3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:7429:x1876325050620928:12345-0@lo:101: Request processed in 144us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.358607:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403115.361504:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e69608ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050620928:0@lo:101: 00010000:00010000:3.0:1789403115.361531:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.361542:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.361667:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb8e52aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621056:0@lo:501: 00000100:00100000:3.0:1789403115.361722:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.361831:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb55092 going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.363064:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621056 00000100:00100000:1.0:1789403115.363073:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621056 00000100:00100000:3.0:1789403115.363239:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403115.363248:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000324106b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:7429:x1876325050621056:12345-0@lo:501: 00000100:00100000:3.0:1789403115.363424:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000324106b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:7429:x1876325050621056:12345-0@lo:501: Request processed in 178us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.363431:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789403115.363644:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb8e52aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621056:0@lo:501: 00000100:00100000:1.0:1789403115.363686:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a7d9b12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621184:0@lo:503: 00000100:00100000:1.0:1789403115.363733:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403115.363757:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b965ce6 going to sleep for 11 seconds 00000100:00100000:3.0:1789403115.363884:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621184 00000100:00100000:3.0:1789403115.363889:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621184 00000100:00100000:3.0:1789403115.363923:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789403115.363930:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f580d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:7429:x1876325050621184:12345-0@lo:503: 00000040:00080000:3.0:1789403115.364113:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403115.364157:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f580d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:7429:x1876325050621184:12345-0@lo:503: Request processed in 228us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.364170:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403115.364486:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a7d9b12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621184:0@lo:503: 00000040:00080000:1.0:1789403115.364750:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403115.364803:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789403115.364876:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789403115.367982:0:6504:0:(import.c:65:import_set_state_nolock()) 00000000592c04a0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403115.368403:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f25af949 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050620416:12345-0@lo:38: Request processed in 15146us (18766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403115.368414:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789403115.370206:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789403115.370281:0:7429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789403115.370491:0:7429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403115.370507:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.370519:0:7429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403115.370569:0:7429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789403115.370572:0:7429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a281b11800 10000000:01000000:3.0:1789403115.370575:0:7429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a281b11800 10000000:01000000:3.0:1789403115.370580:0:7429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403115.370585:0:7429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a281b11800 from 1 10000000:01000000:3.0:1789403115.370588:0:7429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403115.370621:0:7429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.370629:0:7429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.370638:0:7429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.370660:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621312:0@lo:101: 00000100:00100000:3.0:1789403115.370719:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.370759:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082c672ed going to sleep for 11 seconds 00000100:00100000:0.0:1789403115.370932:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403115.370954:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789403115.370962:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789403115.370967:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789403115.370970:0:3625:0:(import.c:65:import_set_state_nolock()) 00000000f3b5023e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789403115.370984:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050620416:0@lo:38: 00000100:00100000:0.0:1789403115.371011:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621312 00000100:00100000:0.0:1789403115.371017:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621312 00000100:00100000:0.0:1789403115.371069:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403115.371078:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002dea9fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:7429:x1876325050621312:12345-0@lo:101: 00010000:00010000:0.0:1789403115.371089:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403115.371100:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097af5e26/0x5fb08b1e5b76084d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760846 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.371120:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097af5e26/0x5fb08b1e5b76084d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.371129:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097af5e26/0x5fb08b1e5b76084d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.371138:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097af5e26, rc 0) 00000100:00100000:0.0:1789403115.371170:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002dea9fb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621312:12345-0@lo:101: Request processed in 95us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.371177:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403115.371252:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050621440:0@lo:41: 00000100:00100000:0.0:1789403115.371278:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.371327:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621440 00000100:00100000:0.0:1789403115.371366:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621440 00000100:00100000:0.0:1789403115.371418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403115.371424:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001108cad7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1876325050621440:12345-0@lo:41: 00000004:00000024:0.0:1789403115.371447:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789403115.371527:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001108cad7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3628:x1876325050621440:12345-0@lo:41: Request processed in 103us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.371532:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403115.371559:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecdc299 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050621440:0@lo:41: 00000100:00100000:3.0:1789403115.371928:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621312:0@lo:101: 00010000:00010000:3.0:1789403115.371960:0:7429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403115.371969:0:7429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.372163:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621568:0@lo:501: 00000100:00100000:3.0:1789403115.372263:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.372364:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082c672ed going to sleep for 11 seconds 00000100:00100000:0.0:1789403115.372523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621568 00000100:00100000:0.0:1789403115.372539:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621568 00000100:00100000:0.0:1789403115.372570:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789403115.372577:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087b63759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621568:12345-0@lo:501: 00000100:00100000:0.0:1789403115.372684:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087b63759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621568:12345-0@lo:501: Request processed in 107us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.372691:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403115.372806:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621568:0@lo:501: 00000100:00100000:3.0:1789403115.372832:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621696:0@lo:503: 00000100:00100000:3.0:1789403115.372875:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.372898:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082c672ed going to sleep for 11 seconds 00000100:00100000:0.0:1789403115.372936:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621696 00000100:00100000:0.0:1789403115.372994:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621696 00000100:00100000:0.0:1789403115.373147:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789403115.373155:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001775f793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621696:12345-0@lo:503: 00000100:00100000:0.0:1789403115.373251:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001775f793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621696:12345-0@lo:503: Request processed in 97us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.373258:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789403115.373548:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621696:0@lo:503: 00000040:00080000:2.0:1789403115.373828:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403115.374509:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ef839f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621824:0@lo:502: 00000100:00100000:2.0:1789403115.374575:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.375241:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024052c07 going to sleep for 11 seconds 00000100:00100000:3.0:1789403115.375377:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621824 00000100:00100000:3.0:1789403115.375385:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621824 00000100:00100000:3.0:1789403115.375513:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403115.375520:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8e5a16e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621824:12345-0@lo:502: 00000100:00100000:3.0:1789403115.379878:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8e5a16e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621824:12345-0@lo:502: Request processed in 4350us (5295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.379891:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789403115.380690:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ef839f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621824:0@lo:502: 00000040:00080000:2.0:1789403115.381019:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789403115.381110:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789403115.381132:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789403115.381147:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789403115.381160:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789403115.381172:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789403115.381184:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789403115.381247:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789403115.381263:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789403115.381276:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789403115.381364:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789403115.381381:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789403115.381634:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789403115.381651:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789403115.381679:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789403115.381695:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789403115.381707:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789403115.381719:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789403115.381731:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789403115.381755:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789403115.381767:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789403115.381780:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789403115.381793:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789403115.381806:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789403115.381818:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789403115.381832:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789403115.381845:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789403115.381856:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789403115.381890:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ef839f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621952:0@lo:502: 00000100:00100000:2.0:1789403115.382850:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.382903:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024052c07 going to sleep for 11 seconds 00000100:00100000:3.0:1789403115.382972:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050621952 00000100:00100000:3.0:1789403115.382981:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050621952 00000100:00100000:3.0:1789403115.383072:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789403115.383081:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f00b8ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621952:12345-0@lo:502: 00000100:00100000:3.0:1789403115.383219:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f00b8ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050621952:12345-0@lo:502: Request processed in 139us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.383227:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789403115.383314:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ef839f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050621952:0@lo:502: 00000040:00080000:2.0:1789403115.383412:0:7429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789403115.383424:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789403115.385162:0:7448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789403115.385209:0:7448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000082f10309) 00000020:00000080:2.0:1789403115.385233:0:7448:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789403115.385683:0:7448:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073d8681c from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789403115.385688:0:7448:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000073d8681c from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789403115.385690:0:7448:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000073d8681c 3 00010000:00080000:2.0:1789403115.385718:0:7448:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000760ce345@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403115.399818:0:7448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789403115.400100:0:7448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789403115.400152:0:7448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789403115.400165:0:7448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5fb08b1e5b76085b 00000100:00080000:1.0:1789403115.400175:0:7448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403115.400185:0:7448:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000760ce345 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403115.400232:0:7448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005a7d9b12 x1876325050622080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403115.400259:0:7448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789403115.400446:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a7d9b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050622080:0@lo:38: 00000100:00100000:3.0:1789403115.400512:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.400587:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622080 00000100:00100000:3.0:1789403115.400593:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622080 00000100:00100000:3.0:1789403115.400621:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403115.400626:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009dd4765f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050622080:12345-0@lo:38: 00010000:00080000:3.0:1789403115.400648:0:6500:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1789403115.400679:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb08b1e5b760862 00000004:00100000:3.0:1789403115.400691:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789403115.400718:0:6500:0:(import.c:65:import_set_state_nolock()) 000000000d264252 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403115.400763:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009dd4765f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876325050622080:12345-0@lo:38: Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.400770:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789403115.400804:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005a7d9b12 x1876325050622080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403115.400814:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403115.400820:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789403115.400826:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789403115.400830:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789403115.400832:0:3625:0:(import.c:65:import_set_state_nolock()) 00000000760ce345 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789403115.400836:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a7d9b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050622080:0@lo:38: 00000040:00080000:3.0:1789403115.401830:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1789403115.402012:0:7449:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1789403115.403059:0:7429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789403115.403096:0:7429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403115.403115:0:7429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.403127:0:7429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000007406050/0x5fb08b1e5b760846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789403115.403182:0:7429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789403115.403185:0:7429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789403115.403187:0:7429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403115.403188:0:7429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403115.403189:0:7429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403115.403190:0:7429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403115.403206:0:7429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403115.403207:0:7429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403115.403208:0:7429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403115.403210:0:7429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403115.403211:0:7429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403115.403215:0:7429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789403115.403218:0:7429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403115.403219:0:7429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789403115.403220:0:7429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403115.403221:0:7429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403115.403222:0:7429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403115.403223:0:7429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403115.403224:0:7429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403115.403232:0:7429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403115.403233:0:7429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403115.403234:0:7429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403115.403235:0:7429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403115.403256:0:7429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789403115.403272:0:7429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013fbc2c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050622208:0@lo:253: 00000100:00100000:1.0:1789403115.403353:0:7429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403115.403418:0:7429:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c99850d going to sleep for 11 seconds 00000100:00100000:2.0:1789403115.403541:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622208 00000100:00100000:2.0:1789403115.403549:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622208 00000100:00100000:2.0:1789403115.403596:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789403115.403604:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd9e2ccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050622208:12345-0@lo:253: 20000000:01000000:2.0:1789403115.403628:0:6493:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789403115.403641:0:6493:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789403115.406069:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789403115.406138:0:6493:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789403115.406152:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789403115.406500:0:6515:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789403115.406506:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789403115.406589:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.406610:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.406616:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.406622:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.406655:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.406668:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 15 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403115.406680:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ef839f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050622336:0@lo:104: 00000100:00100000:2.0:1789403115.406737:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403115.406779:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403115.406787:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 15 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403115.406794:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ab76d4f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050622464:0@lo:104: 00000100:00100000:2.0:1789403115.406812:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.407047:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c93e416c going to sleep for 11 seconds 00000100:00100000:1.0:1789403115.414543:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622336 00000100:00100000:1.0:1789403115.414559:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622336 00000100:00100000:1.0:1789403115.414603:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622464 00000100:00100000:1.0:1789403115.414606:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622464 00000100:00100000:1.0:1789403115.414624:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403115.414632:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004936b781 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6515:x1876325050622336:12345-0@lo:104: 00010000:00010000:1.0:1789403115.414650:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.414808:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ef839f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050622336:0@lo:104: 00000100:00100000:0.0:1789403115.415867:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd9e2ccb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7429:x1876325050622208:12345-0@lo:253: Request processed in 12262us (12511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.415878:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1789403115.425028:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403115.425044:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004936b781 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6515:x1876325050622336:12345-0@lo:104: Request processed in 10408us (18302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.425064:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403115.425095:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403115.425109:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a65ab53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050622464:12345-0@lo:104: 00010000:00010000:1.0:1789403115.425149:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425252:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789403115.425256:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a65ab53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050622464:12345-0@lo:104: Request processed in 155us (18444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403115.425275:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789403115.425293:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403115.425298:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425305:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002943d25e already unused, calling callback (000000002e5bd7ad) 10000000:00010000:1.0:1789403115.425308:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425315:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403115.425321:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403115.425327:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403115.425368:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425375:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403115.425419:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425426:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 000000002943d25e/0x5fb08b1e5b760823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76082a expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425436:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403115.425438:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425454:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1ea9186 already unused, calling callback (000000002e5bd7ad) 10000000:00010000:1.0:1789403115.425457:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425463:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403115.425468:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403115.425473:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403115.425484:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425489:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403115.425501:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425506:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 00000000b1ea9186/0x5fb08b1e5b760782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760789 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403115.425521:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403115.425523:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403115.425827:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ab76d4f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050622464:0@lo:104: 00010000:00010000:3.0:1789403115.425851:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.425889:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b97b2ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050622592:0@lo:103: 00000100:00100000:3.0:1789403115.425928:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403115.426162:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403115.426289:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050622720:0@lo:103: 00000100:00100000:0.0:1789403115.426320:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.426375:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622592 00000100:00100000:0.0:1789403115.426382:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622592 00010000:00010000:0.0:1789403115.426423:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 15 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.426446:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622720 00000100:00100000:0.0:1789403115.426449:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622720 00010000:00010000:0.0:1789403115.426459:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 16 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403115.426470:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403115.426475:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e029628d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3629:x1876325050622592:12345-0@lo:103: 00010000:00010000:0.0:1789403115.426485:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403115.426488:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 16 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426497:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 16 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426509:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a7148a3/0x5fb08b1e5b76082a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760823 expref: 16 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426519:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403115.426620:0:6486:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789403115.426629:0:6486:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789403115.426765:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e029628d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3629:x1876325050622592:12345-0@lo:103: Request processed in 290us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.426772:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403115.426785:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403115.426790:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f49f6ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:3626:x1876325050622720:12345-0@lo:103: 00010000:00010000:0.0:1789403115.426798:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403115.426801:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 14 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426815:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 14 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426825:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b760789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760782 expref: 14 pid: 6495 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426835:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426842:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789403115.426855:0:6487:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020350140s 00010000:00010000:0.0:1789403115.426859:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426865:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426870:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426876:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426881:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd0969ef already unused, calling callback (0000000042c3b639) 00010000:00010000:0.0:1789403115.426884:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426891:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426910:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.426918:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403115.426954:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f49f6ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:3626:x1876325050622720:12345-0@lo:103: Request processed in 164us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.426960:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403115.427010:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050622720:0@lo:103: 00010000:00010000:0.0:1789403115.427028:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.427034:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403115.427039:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd0969ef/0x5fb08b1e5b760869 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403115.427380:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b97b2ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050622592:0@lo:103: 00010000:00010000:1.0:1789403115.427726:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403115.427767:0:7429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013fbc2c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7429:1876325050622208:0@lo:253: 10000000:01000000:1.0:1789403115.427779:0:7429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789403115.427782:0:7429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789403115.427784:0:7429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789403115.427785:0:7429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403115.427795:0:7429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403115.427796:0:7429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403115.427797:0:7429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403115.427798:0:7429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403115.427800:0:7429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403115.427801:0:7429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403115.427802:0:7429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403115.427803:0:7429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789403115.427813:0:7429:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789403115.443032:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789403115.443838:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789403115.444046:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789403115.444254:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789403115.444499:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789403115.445790:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789403115.453218:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789403115.453556:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789403115.453743:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789403115.453894:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789403115.454062:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789403115.454252:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789403115.459805:0:7429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789403115.460189:0:7455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789403115.460253:0:7455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047bf77a6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7455:1876325050622848:0@lo:700: 00000100:00100000:3.0:1789403115.460315:0:7455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403115.460379:0:7455:0:(client.c:2716:ptlrpc_set_wait()) set 000000008701c0fd going to sleep for 11 seconds 00000100:00100000:2.0:1789403115.460655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622848 00000100:00100000:2.0:1789403115.460663:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622848 00000100:00100000:2.0:1789403115.460715:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403115.460722:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026bf92f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7455:x1876325050622848:12345-0@lo:700: 00000040:01000000:1.0:1789403115.460885:0:7429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:0.0:1789403115.461973:0:7454:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789403115.461979:0:7454:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789403115.462287:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013fbc2c4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050622976:0@lo:1000: 00000100:00100000:1.0:1789403115.462364:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.462503:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050622976 00000100:00100000:0.0:1789403115.462510:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050622976 00000100:00100000:0.0:1789403115.462646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403115.462655:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2f45f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050622976:12345-0@lo:1000: 00000100:00100000:1.0:1789403115.462796:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021f29a88 going to sleep for 11 seconds 00000040:01000000:3.0:1789403115.464715:0:7429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789403115.464863:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:2.0:1789403115.466307:0:6506:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00000080:3.0:1789403115.467658:0:7429:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789403115.467677:0:7429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789403115.468779:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403115.473083:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2f45f38 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050622976:12345-0@lo:1000: Request processed in 10421us (10709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.473100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403115.473173:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013fbc2c4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050622976:0@lo:1000: 00000040:01000000:0.0:1789403115.473230:0:7456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1789403115.473273:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e30f1186 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623104:0@lo:700: 00000100:00100000:0.0:1789403115.473308:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.473354:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046023a37 going to sleep for 11 seconds 00000040:00080000:3.0:1789403115.474222:0:7429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1789403115.474447:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050623104 00000100:00100000:0.0:1789403115.474454:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050623104 00000100:00100000:0.0:1789403115.474501:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403115.474509:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bc91694 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623104:12345-0@lo:700: 00000100:00100000:0.0:1789403115.474864:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bc91694 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623104:12345-0@lo:700: Request processed in 355us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.475091:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403115.475139:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e30f1186 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623104:0@lo:700: 00000100:00100000:0.0:1789403115.475203:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e30f1186 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7456:1876325050623232:0@lo:900: 00000100:00100000:0.0:1789403115.475234:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.475260:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046023a37 going to sleep for 11 seconds 00000040:00080000:3.0:1789403115.477828:0:7429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1789403115.478617:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050623232 00000100:00100000:3.0:1789403115.478629:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050623232 00000100:00100000:3.0:1789403115.478682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403115.478690:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb0bf22 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7456:x1876325050623232:12345-0@lo:900: 00000100:00100000:3.0:1789403115.478784:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb0bf22 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7456:x1876325050623232:12345-0@lo:900: Request processed in 94us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403115.478791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1789403115.478820:0:7429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:1.0:1789403115.479182:0:7456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e30f1186 x1876325050623232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403131 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403115.479199:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e30f1186 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7456:1876325050623232:0@lo:900: 00000100:00100000:1.0:1789403115.479294:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000561acd24 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623360:0@lo:1000: 00000100:00100000:1.0:1789403115.479362:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403115.479422:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a643e441 going to sleep for 11 seconds 00000040:00080000:3.0:1789403115.479795:0:7429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403115.481684:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050623360 00000100:00100000:0.0:1789403115.481698:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050623360 00000100:00100000:0.0:1789403115.481757:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403115.481766:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f06e1bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623360:12345-0@lo:1000: 00000100:00100000:0.0:1789403115.481882:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f06e1bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623360:12345-0@lo:1000: Request processed in 106us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.481889:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403115.482539:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000561acd24 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623360:0@lo:1000: 00000004:00080000:1.0:1789403115.482611:0:7456:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000cee5ded9 with version 0 00000020:00100000:1.0:1789403115.482634:0:7456:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789403115.482641:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000561acd24 x1876325050623616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403115.482659:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000561acd24 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623616:0@lo:1000: 00000100:00100000:1.0:1789403115.482701:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403115.482738:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 000000003973a3eb going to sleep for 11 seconds 00000100:00100000:0.0:1789403115.482849:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050623616 00000100:00100000:0.0:1789403115.482855:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050623616 00000100:00100000:0.0:1789403115.482894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403115.482899:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c192aaab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623616:12345-0@lo:1000: 00000100:00100000:2.0:1789403115.483728:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026bf92f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7455:x1876325050622848:12345-0@lo:700: Request processed in 23006us (23412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403115.483738:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1789403115.483845:0:7429:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789403115.484652:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789403115.484787:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789403115.484916:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789403115.485043:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789403115.485193:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000001:00080000:2.0:1789403115.487867:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1789403115.488160:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c192aaab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623616:12345-0@lo:1000: Request processed in 5258us (5456us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789403115.488181:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789403115.488229:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789403115.488234:0:7456:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789403115.488248:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000561acd24 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623616:0@lo:1000: 00000100:00100000:0.0:1789403115.488327:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba12a846 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623744:0@lo:1000: 00000100:00100000:0.0:1789403115.488374:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403115.488430:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050623744 00000100:00100000:0.0:1789403115.488436:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050623744 00000100:00100000:0.0:1789403115.488474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403115.488481:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ecdc299 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623744:12345-0@lo:1000: 00000100:00100000:0.0:1789403115.488643:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ecdc299 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876325050623744:12345-0@lo:1000: Request processed in 162us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403115.488650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403115.488678:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 0000000013f69285 going to sleep for 11 seconds 00000100:00100000:0.0:1789403115.488691:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba12a846 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876325050623744:0@lo:1000: 00000040:00080000:0.0:1789403115.488706:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789403115.488731:0:7456:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a68d6143 with version 1 00000004:00080000:2.0:1789403115.489136:0:7445:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000057a62cdf version 1 rpc_version 1 00000020:00100000:2.0:1789403115.489155:0:7445:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789403115.489162:0:7445:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000028a56407 x1876325050624000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403115.489178:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1876325050624000:0@lo:1000: 00000100:00100000:2.0:1789403115.489222:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403115.489240:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024052c07 going to sleep for 11 seconds 00000100:00100000:2.0:1789403115.489255:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624000 00000100:00100000:2.0:1789403115.489260:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624000 00000100:00100000:2.0:1789403115.489279:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403115.489284:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a89bff81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876325050624000:12345-0@lo:1000: 00100000:10000000:3.0:1789403115.494088:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789403115.494291:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789403115.494486:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789403115.494690:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789403115.494820:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789403115.494967:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789403115.495081:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789403115.495230:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789403115.495366:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789403115.495508:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789403115.495638:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789403115.495947:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789403115.496069:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789403115.496197:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789403115.496333:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789403115.496504:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789403115.496632:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789403115.496775:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789403115.496943:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789403115.497093:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00010000:00080000:1.0:1789403115.500669:0:7455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000047bf77a6 x1876325050622848/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789403131 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403115.500689:0:7455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047bf77a6 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7455:1876325050622848:0@lo:700: 40000000:02000000:1.0:1789403115.500704:0:7455:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1789403115.503712:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1789403115.503833:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a89bff81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1876325050624000:12345-0@lo:1000: Request processed in 14546us (14608us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789403115.503844:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789403115.503901:0:7445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789403115.503905:0:7445:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789403115.503933:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1876325050624000:0@lo:1000: 00000040:00080000:0.0:1789403115.509315:0:7456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789403115.509438:0:7456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1789403115.514884:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789403115.515180:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789403115.515333:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789403115.515511:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789403115.515680:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789403115.515813:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789403115.515954:0:7429:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789403115.516154:0:7429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789403115.527868:0:7429:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789403115.527917:0:7429:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb21c1c83988 00100000:10000000:1.0:1789403115.527926:0:7429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789403115.529054:0:7429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789403115.529086:0:7429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789403115.529107:0:7429:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789403115.529127:0:7429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789403115.531738:0:7429:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403115.531947:0:7429:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1789403115.619205:0:7455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403115.647824:0:7455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789403115.647909:0:7455:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789403115.647914:0:7455:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789403116.019087:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403117.043314:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403118.065622:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403119.101513:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403120.116886:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403120.882059:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa54e154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050624128:0@lo:41: 00000100:00100000:0.0:1789403120.882132:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403120.882274:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624128 00000100:00100000:3.0:1789403120.882282:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624128 00000100:00100000:3.0:1789403120.882348:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403120.882357:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba12a846 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050624128:12345-0@lo:41: 00000004:00000024:3.0:1789403120.882675:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789403120.885247:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba12a846 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050624128:12345-0@lo:41: Request processed in 2885us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403120.885262:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403120.885287:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa54e154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050624128:0@lo:41: 00000100:00100000:1.0:1789403120.885967:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013fbc2c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050624512:0@lo:400: 00000100:00100000:1.0:1789403120.886022:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403120.886108:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b17429e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050624256:0@lo:400: 00000100:00100000:3.0:1789403120.886144:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403120.886178:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403120.886183:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000561acd24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050624384:0@lo:400: 00000100:00100000:3.0:1789403120.886203:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403120.886231:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624512 00000100:00100000:3.0:1789403120.886237:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624512 00000100:00100000:3.0:1789403120.886271:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624384 00000100:00100000:3.0:1789403120.886274:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624384 00000100:00100000:3.0:1789403120.886288:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403120.886295:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b97b2ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050624512:12345-0@lo:400: 00000100:00100000:3.0:1789403120.886350:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b97b2ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050624512:12345-0@lo:400: Request processed in 56us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403120.886357:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403120.886465:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403120.886474:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d17c776 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050624384:12345-0@lo:400: 00000100:00100000:3.0:1789403120.886582:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d17c776 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050624384:12345-0@lo:400: Request processed in 110us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403120.886602:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789403120.886636:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000013fbc2c4 x1876325050624512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403120.886648:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013fbc2c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050624512:0@lo:400: 00010000:00080000:3.0:1789403120.886671:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000561acd24 x1876325050624384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403120.886680:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000561acd24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050624384:0@lo:400: 00000100:00100000:1.0:1789403120.886985:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624256 00000100:00100000:1.0:1789403120.886991:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624256 00000100:00100000:1.0:1789403120.887027:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789403120.887033:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b877bbb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:3628:x1876325050624256:12345-0@lo:400: 00000100:00100000:1.0:1789403120.887066:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b877bbb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:3628:x1876325050624256:12345-0@lo:400: Request processed in 34us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403120.887072:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403120.887148:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b17429e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050624256:0@lo:400: 00010000:00010000:3.0:1789403121.144429:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789403122.044224:0:7700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789403122.163596:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789403123.139631:0:7753:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403123.139848:0:7753:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403123.190014:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403124.209657:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789403124.977831:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403124.977840:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b11800 from 4 10000000:01000000:1.0:1789403124.977844:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403124.977890:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.977902:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.977912:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403124.977934:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050624640:0@lo:101: 00000100:00100000:1.0:1789403124.978005:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403124.978061:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf0547cb going to sleep for 11 seconds 00000100:00100000:3.0:1789403124.978118:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624640 00000100:00100000:3.0:1789403124.978126:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624640 00000100:00100000:3.0:1789403124.978178:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789403124.978186:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f12b7f9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:6497:x1876325050624640:12345-0@lo:101: 00010000:00010000:3.0:1789403124.978197:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403124.978208:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760870 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403124.978228:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403124.978236:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038c96b5e/0x5fb08b1e5b760877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403124.978263:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038c96b5e, rc 0) 00000100:00100000:3.0:1789403124.978325:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f12b7f9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:6497:x1876325050624640:12345-0@lo:101: Request processed in 139us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403124.978331:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789403124.978613:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050624640:0@lo:101: 00010000:00010000:1.0:1789403124.978627:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.978634:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403124.978691:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050624768:0@lo:256: 00000100:00100000:1.0:1789403124.978722:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403124.978756:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf0547cb going to sleep for 11 seconds 00000100:00100000:0.0:1789403124.980490:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624768 00000100:00100000:0.0:1789403124.980505:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624768 00000100:00100000:0.0:1789403124.980570:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403124.980579:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f516fa53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:6497:x1876325050624768:12345-0@lo:256: 20000000:01000000:0.0:1789403124.980602:0:6495:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789403124.980623:0:6495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789403124.980626:0:6495:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789403124.980749:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f516fa53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:6497:x1876325050624768:12345-0@lo:256: Request processed in 171us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403124.980757:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789403124.981499:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050624768:0@lo:256: 10000000:01000000:1.0:1789403124.981555:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403124.981573:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.981590:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 0000000080f8ce11/0x5fb08b1e5b760870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403124.981600:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789403124.981603:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a244ea0000 from 21 10000000:01000000:1.0:1789403124.981606:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403124.981635:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.981642:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.981650:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403124.981666:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050624896:0@lo:101: 00000100:00100000:1.0:1789403124.981715:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403124.981753:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf0547cb going to sleep for 11 seconds 00000100:00100000:3.0:1789403124.981882:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050624896 00000100:00100000:3.0:1789403124.981888:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050624896 00000100:00100000:3.0:1789403124.981929:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789403124.981935:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f43ee1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:6497:x1876325050624896:12345-0@lo:101: 00010000:00010000:3.0:1789403124.981944:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403124.981955:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1ea9186/0x5fb08b1e5b760885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76087e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403124.981975:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1ea9186/0x5fb08b1e5b760885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403124.981984:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1ea9186/0x5fb08b1e5b760885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403124.981992:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1ea9186, rc 0) 00000100:00100000:3.0:1789403124.982031:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f43ee1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050624896:12345-0@lo:101: Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403124.982037:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789403124.982148:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050624896:0@lo:101: 00010000:00010000:1.0:1789403124.982160:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403124.982169:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403124.982221:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625024:0@lo:501: 00000100:00100000:1.0:1789403124.982245:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403124.982285:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf0547cb going to sleep for 11 seconds 00000100:00100000:3.0:1789403124.982421:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625024 00000100:00100000:3.0:1789403124.982427:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625024 00000100:00100000:3.0:1789403124.982458:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789403124.982464:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0995c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050625024:12345-0@lo:501: 00000100:00100000:3.0:1789403124.982592:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0995c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050625024:12345-0@lo:501: Request processed in 128us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403124.982605:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789403124.982869:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf268e80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625024:0@lo:501: 00000100:00100000:2.0:1789403124.982904:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625152:0@lo:503: 00000100:00100000:2.0:1789403124.982945:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403124.982976:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017b8c2b3 going to sleep for 11 seconds 00000100:00100000:0.0:1789403124.983415:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625152 00000100:00100000:0.0:1789403124.983422:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625152 00000100:00100000:0.0:1789403124.983449:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789403124.983463:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009aeed90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050625152:12345-0@lo:503: 00000100:00100000:0.0:1789403124.983572:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009aeed90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050625152:12345-0@lo:503: Request processed in 109us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403124.983579:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789403124.983812:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625152:0@lo:503: 00000100:00100000:3.0:1789403125.000002:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7805:1876325050625280:0@lo:502: 00000100:00100000:3.0:1789403125.000115:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.000166:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1d342ba going to sleep for 11 seconds 00000100:00100000:1.0:1789403125.000737:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625280 00000100:00100000:1.0:1789403125.000746:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625280 00000100:00100000:1.0:1789403125.000795:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403125.000804:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000732c499f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7805:x1876325050625280:12345-0@lo:502: 00000100:00100000:1.0:1789403125.000949:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000732c499f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7805:x1876325050625280:12345-0@lo:502: Request processed in 146us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403125.000957:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789403125.001163:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7805:1876325050625280:0@lo:502: 00000100:00100000:2.0:1789403125.001218:0:7805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7805:1876325050625408:0@lo:502: 00000100:00100000:2.0:1789403125.001255:0:7805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403125.001300:0:7805:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017b8c2b3 going to sleep for 11 seconds 00000100:00100000:3.0:1789403125.001477:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625408 00000100:00100000:3.0:1789403125.001482:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625408 00000100:00100000:3.0:1789403125.001518:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789403125.001525:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084dfe103 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7805:x1876325050625408:12345-0@lo:502: 00000100:00100000:3.0:1789403125.001610:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084dfe103 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:7805:x1876325050625408:12345-0@lo:502: Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403125.001617:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789403125.001788:0:7805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7805:1876325050625408:0@lo:502: 00000040:00080000:2.0:1789403125.001808:0:7805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789403125.008719:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789403125.008758:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789403125.008768:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.008781:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000ccf6a269/0x5fb08b1e5b76087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403125.008793:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789403125.008796:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a244ea0000 from 4 10000000:01000000:3.0:1789403125.008799:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403125.008845:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.008853:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.008881:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403125.008904:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625536:0@lo:101: 00000100:00100000:3.0:1789403125.008965:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.009016:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d68d7e34 going to sleep for 11 seconds 00000100:00100000:0.0:1789403125.009906:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625536 00000100:00100000:0.0:1789403125.009915:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625536 00000100:00100000:0.0:1789403125.009971:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789403125.009979:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d22b908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050625536:12345-0@lo:101: 00010000:00010000:0.0:1789403125.009993:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403125.010006:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c445e26/0x5fb08b1e5b760893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76088c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.010028:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c445e26/0x5fb08b1e5b760893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.010038:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c445e26/0x5fb08b1e5b760893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.010046:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c445e26, rc 0) 00000100:00100000:0.0:1789403125.010116:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d22b908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050625536:12345-0@lo:101: Request processed in 138us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403125.010123:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403125.010355:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625536:0@lo:101: 00010000:00010000:3.0:1789403125.010377:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.010412:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403125.010474:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625664:0@lo:256: 00000100:00100000:3.0:1789403125.010508:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.010538:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d68d7e34 going to sleep for 11 seconds 00000100:00100000:1.0:1789403125.010793:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625664 00000100:00100000:1.0:1789403125.010799:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625664 00000100:00100000:1.0:1789403125.010835:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789403125.010841:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a78fd5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050625664:12345-0@lo:256: 20000000:01000000:1.0:1789403125.010855:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403125.010871:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403125.010874:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789403125.010958:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a78fd5b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050625664:12345-0@lo:256: Request processed in 117us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403125.010965:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789403125.012961:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625664:0@lo:256: 10000000:01000000:3.0:1789403125.013033:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789403125.013042:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.013053:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000b1f5fedc/0x5fb08b1e5b76088c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403125.013076:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789403125.013079:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789403125.013091:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789403125.013119:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.013127:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.013135:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403125.013152:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625792:0@lo:101: 00000100:00100000:3.0:1789403125.013202:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.013245:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d68d7e34 going to sleep for 11 seconds 00000100:00100000:2.0:1789403125.013314:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625792 00000100:00100000:2.0:1789403125.013322:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625792 00000100:00100000:2.0:1789403125.013367:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789403125.013382:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085dbbacd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050625792:12345-0@lo:101: 00010000:00010000:2.0:1789403125.013436:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403125.013448:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029fc8110/0x5fb08b1e5b7608a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76089a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403125.013469:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029fc8110/0x5fb08b1e5b7608a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403125.013487:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029fc8110/0x5fb08b1e5b7608a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403125.013495:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029fc8110, rc 0) 00000100:00100000:2.0:1789403125.013532:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085dbbacd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050625792:12345-0@lo:101: Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.013538:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789403125.013715:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007810a9a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625792:0@lo:101: 00010000:00010000:0.0:1789403125.013727:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.013735:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403125.013804:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625920:0@lo:501: 00000100:00100000:0.0:1789403125.013832:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403125.013864:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d98e48e going to sleep for 11 seconds 00000100:00100000:1.0:1789403125.013926:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050625920 00000100:00100000:1.0:1789403125.013931:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050625920 00000100:00100000:1.0:1789403125.013965:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789403125.013971:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035dd9fe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050625920:12345-0@lo:501: 00000100:00100000:1.0:1789403125.014087:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035dd9fe1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050625920:12345-0@lo:501: Request processed in 116us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403125.014094:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789403125.014240:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050625920:0@lo:501: 00000100:00100000:0.0:1789403125.014278:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050626048:0@lo:503: 00000100:00100000:0.0:1789403125.014320:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403125.014342:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d98e48e going to sleep for 11 seconds 00000100:00100000:1.0:1789403125.014507:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626048 00000100:00100000:1.0:1789403125.014513:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626048 00000100:00100000:1.0:1789403125.014544:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789403125.014550:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000894c8681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050626048:12345-0@lo:503: 00000100:00100000:1.0:1789403125.014644:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000894c8681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050626048:12345-0@lo:503: Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403125.014651:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789403125.014769:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050626048:0@lo:503: 00000100:00100000:3.0:1789403125.015742:0:7806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047bf77a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7806:1876325050626176:0@lo:502: 00000100:00100000:3.0:1789403125.015790:0:7806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.015823:0:7806:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e833a8d5 going to sleep for 11 seconds 00000100:00100000:1.0:1789403125.016505:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626176 00000100:00100000:1.0:1789403125.016513:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626176 00000100:00100000:1.0:1789403125.016555:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789403125.016569:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a5d9da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:7806:x1876325050626176:12345-0@lo:502: 00000100:00100000:1.0:1789403125.016693:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a5d9da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:7806:x1876325050626176:12345-0@lo:502: Request processed in 124us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403125.016701:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789403125.017018:0:7806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047bf77a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7806:1876325050626176:0@lo:502: 00000020:01000000:3.0:1789403125.017048:0:7806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403125.017073:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403125.017076:0:7806:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789403125.017081:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403125.017085:0:7806:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:3.0:1789403125.017109:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403125.017134:0:7806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000bb38cfc2) 00000020:00000080:3.0:1789403125.017165:0:7806:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789403125.017172:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403125.017259:0:7806:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789403125.017265:0:7806:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789403125.017284:0:7806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7608af 00010000:00080000:3.0:1789403125.017311:0:7806:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000038e0cfb4@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403125.020619:0:7806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789403125.025076:0:7806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403125.025092:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789403125.025147:0:7806:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789403125.025171:0:7806:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b7608b6 00000100:00080000:1.0:1789403125.025182:0:7806:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403125.025193:0:7806:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000038e0cfb4 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403125.025228:0:7806:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005a7d9b12 x1876325050626304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403125.025256:0:7806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789403125.025321:0:7806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789403125.025739:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403125.025753:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050626432:0@lo:400: 00000100:00100000:2.0:1789403125.025814:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403125.025853:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003915e6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050626560:0@lo:400: 00000100:00100000:2.0:1789403125.025881:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403125.025900:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403125.025905:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc767257 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050626688:0@lo:400: 00000100:00100000:2.0:1789403125.025929:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403125.025959:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626432 00000100:00100000:2.0:1789403125.025965:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626432 00000100:00100000:2.0:1789403125.026003:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626688 00000100:00100000:2.0:1789403125.026007:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626688 00000100:00100000:2.0:1789403125.026023:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403125.026030:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002465f5a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050626432:12345-0@lo:400: 00000100:00100000:2.0:1789403125.026092:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002465f5a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050626432:12345-0@lo:400: Request processed in 62us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.026099:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403125.026114:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403125.026120:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054510054 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050626688:12345-0@lo:400: 00000100:00100000:2.0:1789403125.026162:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054510054 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050626688:12345-0@lo:400: Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.026169:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403125.026188:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626560 00000100:00100000:2.0:1789403125.026191:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626560 00000100:00100000:2.0:1789403125.026216:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403125.026222:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f0a1deb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050626560:12345-0@lo:400: 00000100:00100000:2.0:1789403125.026252:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f0a1deb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050626560:12345-0@lo:400: Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.026259:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789403125.026310:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fc767257 x1876325050626688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403125.026324:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc767257 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050626688:0@lo:400: 00000100:00100000:2.0:1789403125.026334:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003915e6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050626560:0@lo:400: 00010000:00080000:2.0:1789403125.026358:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000028a56407 x1876325050626432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403125.026367:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028a56407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050626432:0@lo:400: 00000100:00100000:3.0:1789403125.026868:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a7d9b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050626304:0@lo:38: 00000100:00100000:3.0:1789403125.026908:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789403125.027231:0:7809:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000e029628d x1876325050626816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403125.027240:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3d4bd89 going to sleep for 0 seconds 00000020:01000000:0.0:1789403125.027363:0:7806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403125.027370:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403125.027372:0:7806:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789403125.027411:0:7806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403125.027416:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403125.027418:0:7806:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789403125.027421:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789403125.027423:0:7806:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789403125.027444:0:7806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7806:1876325050626944:0@lo:502: 00000100:00100000:0.0:1789403125.027489:0:7806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403125.027513:0:7806:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061426ebb going to sleep for 11 seconds 00000100:00100000:3.0:1789403125.027673:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626944 00000100:00100000:3.0:1789403125.027681:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626944 00000100:00100000:3.0:1789403125.027730:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789403125.027737:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020fa00c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:7806:x1876325050626944:12345-0@lo:502: 00000100:00100000:3.0:1789403125.027900:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020fa00c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:7806:x1876325050626944:12345-0@lo:502: Request processed in 163us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403125.027907:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403125.028076:0:7806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:7806:1876325050626944:0@lo:502: 00000020:01000000:0.0:1789403125.028110:0:7806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403125.028116:0:7806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403125.028118:0:7806:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789403125.028121:0:7806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789403125.028526:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789403125.028548:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789403125.028565:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.028576:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 00000000ff2f6c38/0x5fb08b1e5b76089a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403125.028587:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789403125.028590:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a245c9b380 from 1 10000000:01000000:3.0:1789403125.028593:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789403125.028617:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.028624:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403125.028646:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403125.028660:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050627072:0@lo:101: 00000100:00100000:3.0:1789403125.028693:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.028718:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f8e2028 going to sleep for 11 seconds 00000100:00100000:0.0:1789403125.028828:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627072 00000100:00100000:0.0:1789403125.028835:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627072 00000100:00100000:0.0:1789403125.028869:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789403125.028875:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d92962f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050627072:12345-0@lo:101: 00010000:00010000:0.0:1789403125.028884:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403125.028893:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b7608c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7608bd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.028913:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b7608c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.028921:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd551bfd/0x5fb08b1e5b7608c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.028929:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd551bfd, rc 0) 00000100:00100000:0.0:1789403125.028964:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d92962f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050627072:12345-0@lo:101: Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403125.028970:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789403125.029002:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea3516c6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050627072:0@lo:101: 00010000:00010000:0.0:1789403125.029014:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.029022:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403125.032753:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050627200:0@lo:501: 00000100:00100000:0.0:1789403125.032833:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403125.032878:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aef0c83b going to sleep for 11 seconds 00000100:00100000:2.0:1789403125.033001:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626304 00000100:00100000:2.0:1789403125.033010:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626304 00000100:00100000:2.0:1789403125.033058:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403125.033078:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047bf77a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050626304:12345-0@lo:38: 00010000:00080000:2.0:1789403125.033102:0:6505:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1789403125.033135:0:6505:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b7608cb 00000004:00100000:2.0:1789403125.033150:0:6505:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789403125.033155:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789403125.033774:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627200 00000100:00100000:3.0:1789403125.033780:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627200 00000100:00100000:3.0:1789403125.033821:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789403125.033829:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc723ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050627200:12345-0@lo:501: 00000100:00100000:3.0:1789403125.033920:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc723ef9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050627200:12345-0@lo:501: Request processed in 92us (1087us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789403125.033927:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789403125.036924:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050627200:0@lo:501: 10000000:01000000:0.0:1789403125.036980:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789403125.037009:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403125.037020:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: 000000004318044d/0x5fb08b1e5b7608bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789403125.075250:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000925f1e8e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403125.075624:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047bf77a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050626304:12345-0@lo:38: Request processed in 42541us (48711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403125.075636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789403125.076611:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403125.076623:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789403125.076632:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789403125.076638:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789403125.076640:0:3625:0:(import.c:65:import_set_state_nolock()) 0000000038e0cfb4 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789403125.076651:0:3625:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f3d4bd89): req@00000000e029628d x1876325050626816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403125.076677:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a7d9b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050626304:0@lo:38: 00000100:00100000:2.0:1789403125.076817:0:7809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403125.076884:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3d4bd89 going to sleep for 11 seconds 00000100:00100000:3.0:1789403125.076942:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050626816 00000100:00100000:3.0:1789403125.076949:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050626816 00000100:00100000:3.0:1789403125.077004:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403125.077013:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028a56407 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050626816:12345-0@lo:1000: 00000100:00100000:3.0:1789403125.077124:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028a56407 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050626816:12345-0@lo:1000: Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403125.077131:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403125.077537:0:7809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e029628d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050626816:0@lo:1000: 00000040:01000000:1.0:1789403125.077571:0:7809:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789403125.077610:0:7809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627328:0@lo:1000: 00000100:00100000:1.0:1789403125.077646:0:7809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403125.077671:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 000000005320bb70 going to sleep for 11 seconds 00000100:00100000:2.0:1789403125.077726:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627328 00000100:00100000:2.0:1789403125.077732:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627328 00000100:00100000:2.0:1789403125.077756:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403125.077761:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a6324a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050627328:12345-0@lo:1000: 00000100:00100000:2.0:1789403125.077873:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a6324a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050627328:12345-0@lo:1000: Request processed in 112us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.077879:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403125.078694:0:7809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627328:0@lo:1000: 00000100:00100000:1.0:1789403125.078760:0:7809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627456:0@lo:700: 00000100:00100000:1.0:1789403125.078793:0:7809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403125.078819:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 00000000167a5715 going to sleep for 11 seconds 00000100:00100000:2.0:1789403125.081451:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627456 00000100:00100000:2.0:1789403125.081466:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627456 00000100:00100000:2.0:1789403125.081529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403125.081538:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6322310 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050627456:12345-0@lo:700: 00000100:00100000:2.0:1789403125.081627:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6322310 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050627456:12345-0@lo:700: Request processed in 90us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.081634:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403125.081827:0:7809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627456:0@lo:700: 00000100:00100000:1.0:1789403125.082010:0:7809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627584:0@lo:1000: 00000100:00100000:1.0:1789403125.082047:0:7809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403125.082089:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 0000000031f40d4b going to sleep for 11 seconds 00000100:00100000:3.0:1789403125.082323:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050627712:0@lo:41: 00000100:00100000:3.0:1789403125.082355:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403125.082582:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627584 00000100:00100000:0.0:1789403125.082589:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627584 00000100:00100000:0.0:1789403125.082614:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627712 00000100:00100000:0.0:1789403125.082617:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627712 00000100:00100000:0.0:1789403125.082630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403125.082635:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006023ab2c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7809:x1876325050627584:12345-0@lo:1000: 00000100:00100000:0.0:1789403125.082709:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006023ab2c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7809:x1876325050627584:12345-0@lo:1000: Request processed in 73us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403125.082716:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403125.082732:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403125.082737:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb8e52aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050627712:12345-0@lo:41: 00000004:00000024:0.0:1789403125.082759:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789403125.082792:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb8e52aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050627712:12345-0@lo:41: Request processed in 55us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403125.082797:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403125.082872:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002613adaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050627712:0@lo:41: 00000100:00100000:3.0:1789403125.082898:0:7809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000340dc4d8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627584:0@lo:1000: 00000004:00080000:3.0:1789403125.082945:0:7809:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000167a5715 with version 0 00000020:00100000:3.0:1789403125.082959:0:7809:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789403125.082964:0:7809:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000025a6d018 x1876325050627968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403125.082978:0:7809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627968:0@lo:1000: 00000100:00100000:3.0:1789403125.083003:0:7809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.083025:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f64bc01e going to sleep for 11 seconds 00000100:00100000:0.0:1789403125.084866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050627968 00000100:00100000:0.0:1789403125.084879:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050627968 00000100:00100000:0.0:1789403125.084922:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403125.084930:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e72e044 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7809:x1876325050627968:12345-0@lo:1000: 00000001:00080000:1.0:1789403125.087555:0:7431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789403125.087568:0:7431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789403125.088020:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e72e044 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7809:x1876325050627968:12345-0@lo:1000: Request processed in 3089us (5014us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789403125.088034:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1789403125.088139:0:7809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789403125.088145:0:7809:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789403125.088160:0:7809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050627968:0@lo:1000: 00000100:00100000:3.0:1789403125.088250:0:7809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050628096:0@lo:1000: 00000100:00100000:3.0:1789403125.088306:0:7809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403125.088334:0:7809:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa5b8c1 going to sleep for 11 seconds 00000100:00100000:2.0:1789403125.088417:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628096 00000100:00100000:2.0:1789403125.088424:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628096 00000100:00100000:2.0:1789403125.088463:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403125.088469:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8fc49b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7809:x1876325050628096:12345-0@lo:1000: 00000100:00100000:2.0:1789403125.088539:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8fc49b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7809:x1876325050628096:12345-0@lo:1000: Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403125.088544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403125.088778:0:7809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000025a6d018 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7809:1876325050628096:0@lo:1000: 00000040:00080000:3.0:1789403125.088795:0:7809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789403125.088822:0:7809:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f64bc01e with version 1 00000004:00080000:1.0:1789403125.089481:0:7807:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000099337790 version 1 rpc_version 1 00000020:00100000:1.0:1789403125.089504:0:7807:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789403125.089512:0:7807:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ed53f4b6 x1876325050628352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403125.089529:0:7807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7807:1876325050628352:0@lo:1000: 00000100:00100000:1.0:1789403125.089580:0:7807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403125.089608:0:7807:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db9a2dfb going to sleep for 11 seconds 00000100:00100000:2.0:1789403125.091615:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628352 00000100:00100000:2.0:1789403125.091630:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628352 00000100:00100000:2.0:1789403125.091691:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789403125.091699:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af99d4de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7807:x1876325050628352:12345-0@lo:1000: 00000040:00080000:3.0:1789403125.093969:0:7809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789403125.094207:0:7809:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789403125.094226:0:7809:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1789403125.096031:0:7431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789403125.096339:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af99d4de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7807:x1876325050628352:12345-0@lo:1000: Request processed in 4637us (6755us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789403125.096353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1789403125.096604:0:7807:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789403125.096610:0:7807:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789403125.096627:0:7807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7807:1876325050628352:0@lo:1000: 00010000:00010000:0.0:1789403125.235593:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403126.001634:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052095220 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050628480:0@lo:41: 00000100:00100000:3.0:1789403126.001703:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403126.001886:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628480 00000100:00100000:2.0:1789403126.001895:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628480 00000100:00100000:2.0:1789403126.001944:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789403126.001952:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025a6d018 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050628480:12345-0@lo:41: 00000004:00000024:2.0:1789403126.001984:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789403126.002982:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025a6d018 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050628480:12345-0@lo:41: Request processed in 1028us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403126.002993:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403126.009458:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052095220 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050628480:0@lo:41: 00000020:00000004:0.0:1789403126.163123:0:7859:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403126.163646:0:7859:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789403126.258494:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789403127.221766:0:7907:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfaeea750 20000000:00000080:0.0:1789403127.221784:0:7907:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a27c1c8000 uarg=0000000000000000 20000000:01000000:0.0:1789403127.221824:0:7907:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789403127.221831:0:7907:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789403127.221837:0:7907:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789403127.221923:0:7907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789403127.221935:0:7907:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789403127.226801:0:7907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403127.229357:0:7907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789403127.229481:0:7907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789403127.229574:0:7907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789403127.229593:0:7907:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789403127.229613:0:7907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403127.229634:0:7907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403127.229641:0:7907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403127.229647:0:7907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403127.229689:0:7907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403127.229702:0:7907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 17 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403127.229716:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d249adab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7907:1876325050628608:0@lo:104: 00000100:00100000:0.0:1789403127.229781:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403127.229923:0:7907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403127.229932:0:7907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403127.229940:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039a0b38f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7907:1876325050628736:0@lo:104: 00000100:00100000:0.0:1789403127.229972:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050763c92 going to sleep for 11 seconds 00000100:00100000:1.0:1789403127.230130:0:6484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789403127.230150:0:6484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403127.230173:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628608 00000100:00100000:1.0:1789403127.230180:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628608 00000100:00100000:1.0:1789403127.230214:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628736 00000100:00100000:1.0:1789403127.230217:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628736 00000100:00100000:1.0:1789403127.230231:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403127.230238:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c862b54a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:7907:x1876325050628608:12345-0@lo:104: 00010000:00010000:1.0:1789403127.230249:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403127.230330:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403127.230335:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c862b54a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:7907:x1876325050628608:12345-0@lo:104: Request processed in 98us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403127.230341:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403127.230374:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789403127.230379:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cef90fd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:7907:x1876325050628736:12345-0@lo:104: 00010000:00010000:1.0:1789403127.230412:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403127.230445:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789403127.230449:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cef90fd9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:7907:x1876325050628736:12345-0@lo:104: Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403127.230454:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403127.230542:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d249adab pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7907:1876325050628608:0@lo:104: 00000100:00100000:0.0:1789403127.230550:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039a0b38f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7907:1876325050628736:0@lo:104: 00010000:00010000:0.0:1789403127.230566:0:7907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230722:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403127.230729:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230736:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005b450484 already unused, calling callback (000000002e5bd7ad) 10000000:00010000:3.0:1789403127.230739:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230746:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403127.230752:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403127.230758:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403127.230821:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230828:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403127.230857:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230875:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 000000005b450484/0x5fb08b1e5b760838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76083f expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230888:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403127.230890:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230895:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074fdedef already unused, calling callback (000000002e5bd7ad) 10000000:00010000:3.0:1789403127.230897:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.230902:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403127.230907:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403127.230911:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789403127.230941:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403127.230953:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd77fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050628864:0@lo:103: 00000100:00100000:1.0:1789403127.230994:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403127.231042:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628864 00000100:00100000:1.0:1789403127.231047:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628864 00010000:00010000:1.0:1789403127.231064:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 18 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403127.231087:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403127.231093:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004ac18a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:3629:x1876325050628864:12345-0@lo:103: 00010000:00010000:1.0:1789403127.231103:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403127.231106:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 18 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403127.231126:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 18 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403127.231138:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008652f954/0x5fb08b1e5b76083f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760838 expref: 18 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403127.231150:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403127.231177:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004ac18a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:3629:x1876325050628864:12345-0@lo:103: Request processed in 84us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403127.231182:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403127.231222:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd77fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050628864:0@lo:103: 00010000:00010000:2.0:1789403127.231905:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403127.232109:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232119:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789403127.232166:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789403127.232208:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232217:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: 0000000074fdedef/0x5fb08b1e5b76074a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760751 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232233:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403127.232243:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403127.232245:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403127.232283:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd77fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050628992:0@lo:103: 00000100:00100000:2.0:1789403127.232326:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403127.232638:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050628992 00000100:00100000:3.0:1789403127.232645:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050628992 00010000:00010000:3.0:1789403127.232666:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403127.232719:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403127.232725:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003915e6e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:3628:x1876325050628992:12345-0@lo:103: 00010000:00010000:3.0:1789403127.232735:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403127.232739:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232747:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232758:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041191478/0x5fb08b1e5b760751 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76074a expref: 17 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232769:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232775:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232787:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232794:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232799:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232811:0:7451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232817:0:7451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002943d25e already unused, calling callback (0000000042c3b639) 00010000:00010000:3.0:1789403127.232820:0:7451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232827:0:7451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232848:0:7451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403127.232857:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403127.232889:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003915e6e2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3628:x1876325050628992:12345-0@lo:103: Request processed in 165us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403127.232896:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403127.232993:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd77fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050628992:0@lo:103: 00010000:00010000:2.0:1789403127.233025:0:7907:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403127.233033:0:7907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403127.233038:0:7907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002943d25e/0x5fb08b1e5b7608d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403127.285404:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403128.305822:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403129.330554:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403130.099875:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc767257 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050629120:0@lo:400: 00000100:00100000:2.0:1789403130.099984:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.100043:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bef77b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050629632:0@lo:400: 00000100:00100000:2.0:1789403130.100075:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.100120:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403130.100126:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edef1b78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050629248:0@lo:400: 00000100:00100000:2.0:1789403130.100153:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.100189:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004936b781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050629376:0@lo:400: 00000100:00100000:2.0:1789403130.100213:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.100244:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403130.100250:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a65ab53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050629504:0@lo:400: 00000100:00100000:2.0:1789403130.100276:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.100310:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629120 00000100:00100000:2.0:1789403130.100321:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629120 00000100:00100000:2.0:1789403130.100381:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403130.100415:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f30cc0e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3626:x1876325050629120:12345-0@lo:400: 00000100:00100000:2.0:1789403130.100477:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f30cc0e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3626:x1876325050629120:12345-0@lo:400: Request processed in 64us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.100484:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403130.100525:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629632 00000100:00100000:2.0:1789403130.100530:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629632 00000100:00100000:2.0:1789403130.100550:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629376 00000100:00100000:2.0:1789403130.100552:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629376 00000100:00100000:2.0:1789403130.100567:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403130.100572:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ab76d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050629632:12345-0@lo:400: 00000100:00100000:2.0:1789403130.100630:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ab76d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050629632:12345-0@lo:400: Request processed in 58us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.100637:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403130.100650:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789403130.100655:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e69608ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050629376:12345-0@lo:400: 00000100:00100000:2.0:1789403130.100687:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e69608ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050629376:12345-0@lo:400: Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.100700:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789403130.100720:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629248 00000100:00100000:2.0:1789403130.100724:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629248 00000100:00100000:2.0:1789403130.100750:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629504 00000100:00100000:2.0:1789403130.100752:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629504 00000100:00100000:2.0:1789403130.100764:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403130.100770:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ef839f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050629248:12345-0@lo:400: 00000100:00100000:2.0:1789403130.100800:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ef839f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050629248:12345-0@lo:400: Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.100806:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403130.100896:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403130.100903:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c2332e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050629504:12345-0@lo:400: 00000100:00100000:2.0:1789403130.100933:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c2332e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050629504:12345-0@lo:400: Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.100939:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789403130.100995:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a65ab53 x1876325050629504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403130.101012:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a65ab53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050629504:0@lo:400: 00000100:00100000:2.0:1789403130.101025:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004936b781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050629376:0@lo:400: 00010000:00080000:2.0:1789403130.101054:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000edef1b78 x1876325050629248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403130.101064:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edef1b78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050629248:0@lo:400: 00000100:00100000:2.0:1789403130.101073:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc767257 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050629120:0@lo:400: 00000100:00100000:2.0:1789403130.101082:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bef77b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050629632:0@lo:400: 00000100:00100000:2.0:1789403130.103534:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bef77b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050629760:0@lo:41: 00000100:00100000:2.0:1789403130.103644:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.103709:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629760 00000100:00100000:2.0:1789403130.103720:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629760 00000100:00100000:2.0:1789403130.103770:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403130.103779:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc767257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050629760:12345-0@lo:41: 00000004:00000024:2.0:1789403130.103821:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789403130.103872:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc767257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050629760:12345-0@lo:41: Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.103879:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403130.103931:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bef77b6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050629760:0@lo:41: 00010000:00010000:3.0:1789403130.361885:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789403130.417460:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789403130.417471:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b11800 from 1 10000000:01000000:0.0:1789403130.417476:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403130.417526:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: 00000000cd99cdec/0x5fb08b1e5b7608d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403130.417541:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: 00000000cd99cdec/0x5fb08b1e5b7608d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403130.417560:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: 00000000cd99cdec/0x5fb08b1e5b7608d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403130.417587:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039a0b38f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050629888:0@lo:101: 00000100:00100000:0.0:1789403130.417672:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403130.417738:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4aa67ce going to sleep for 11 seconds 00000100:00100000:1.0:1789403130.418453:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050629888 00000100:00100000:1.0:1789403130.418465:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050629888 00000100:00100000:1.0:1789403130.418533:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789403130.418544:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005c1076b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050629888:12345-0@lo:101: 00010000:00010000:1.0:1789403130.418562:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403130.418579:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074fdedef/0x5fb08b1e5b7608e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7608d9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403130.418610:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074fdedef/0x5fb08b1e5b7608e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403130.418621:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074fdedef/0x5fb08b1e5b7608e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403130.418631:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074fdedef, rc 0) 00000100:00100000:1.0:1789403130.418694:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005c1076b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050629888:12345-0@lo:101: Request processed in 151us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403130.418722:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789403130.418794:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039a0b38f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050629888:0@lo:101: 00010000:00010000:1.0:1789403130.418814:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: 00000000cd99cdec/0x5fb08b1e5b7608d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403130.418823:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: 00000000cd99cdec/0x5fb08b1e5b7608d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403130.418904:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630016:0@lo:501: 00000100:00100000:1.0:1789403130.419421:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403130.419452:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb8f1d64 going to sleep for 11 seconds 00000100:00100000:1.0:1789403130.419475:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630016 00000100:00100000:1.0:1789403130.419480:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630016 00000100:00100000:1.0:1789403130.419515:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789403130.419522:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084306f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050630016:12345-0@lo:501: 00000100:00100000:1.0:1789403130.419663:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084306f7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050630016:12345-0@lo:501: Request processed in 141us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403130.419671:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789403130.419953:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630016:0@lo:501: 00000100:00100000:1.0:1789403130.419998:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630144:0@lo:503: 00000100:00100000:1.0:1789403130.420047:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403130.420070:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb8f1d64 going to sleep for 11 seconds 00000100:00100000:3.0:1789403130.420173:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630144 00000100:00100000:3.0:1789403130.420179:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630144 00000100:00100000:3.0:1789403130.420211:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789403130.420216:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d94ca92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050630144:12345-0@lo:503: 00000100:00100000:3.0:1789403130.420312:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d94ca92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050630144:12345-0@lo:503: Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403130.420318:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789403130.420649:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed53f4b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630144:0@lo:503: 00000100:00100000:0.0:1789403130.428335:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d249adab pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8052:1876325050630272:0@lo:502: 00000100:00100000:0.0:1789403130.428911:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403130.429030:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4aa67ce going to sleep for 11 seconds 00000100:00100000:3.0:1789403130.429115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630272 00000100:00100000:3.0:1789403130.429125:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630272 00000100:00100000:3.0:1789403130.429194:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789403130.429214:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ee48e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8052:x1876325050630272:12345-0@lo:502: 00000100:00100000:3.0:1789403130.429382:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ee48e26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8052:x1876325050630272:12345-0@lo:502: Request processed in 170us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403130.429409:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789403130.429588:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d249adab pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8052:1876325050630272:0@lo:502: 00000020:01000000:2.0:1789403130.429626:0:8052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403130.429637:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403130.429640:0:8052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789403130.429648:0:8052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a281b11800 00000020:00000080:2.0:1789403130.429650:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789403130.429714:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8052:1876325050630400:0@lo:502: 00000100:00100000:2.0:1789403130.429755:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.429783:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789403130.429915:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630400 00000100:00100000:3.0:1789403130.429921:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630400 00000100:00100000:3.0:1789403130.429960:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789403130.429968:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8052:x1876325050630400:12345-0@lo:502: 00000100:00100000:3.0:1789403130.430035:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8052:x1876325050630400:12345-0@lo:502: Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403130.430042:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789403130.430165:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8052:1876325050630400:0@lo:502: 00000020:01000000:2.0:1789403130.430186:0:8052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403130.430190:0:8052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403130.430192:0:8052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789403130.430197:0:8052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789403130.430605:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789403130.430631:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403130.430644:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403130.430657:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403130.430669:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403130.430672:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a244ea0000 from 1 10000000:01000000:3.0:1789403130.430675:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403130.430779:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403130.430861:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403130.430874:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403130.430902:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630528:0@lo:101: 00000100:00100000:3.0:1789403130.431017:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403130.431057:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a259988d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403130.431107:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630528 00000100:00100000:2.0:1789403130.431114:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630528 00000100:00100000:2.0:1789403130.431163:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789403130.431172:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050630528:12345-0@lo:101: 00010000:00010000:2.0:1789403130.431184:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403130.431198:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7608e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403130.431225:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403130.431247:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403130.431256:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947000, rc 0) 00000100:00100000:2.0:1789403130.431303:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050630528:12345-0@lo:101: Request processed in 133us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.431309:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789403130.431522:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630528:0@lo:101: 00010000:00010000:0.0:1789403130.431538:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403130.431549:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403130.431617:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630656:0@lo:501: 00000100:00100000:0.0:1789403130.431649:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403130.431674:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2819dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403130.431877:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630656 00000100:00100000:2.0:1789403130.431883:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630656 00000100:00100000:2.0:1789403130.431914:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789403130.431921:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050630656:12345-0@lo:501: 00000100:00100000:2.0:1789403130.432129:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050630656:12345-0@lo:501: Request processed in 207us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.432136:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789403130.432174:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630656:0@lo:501: 00000100:00100000:2.0:1789403130.432207:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630784:0@lo:503: 00000100:00100000:2.0:1789403130.432260:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403130.432275:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789403130.432287:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630784 00000100:00100000:2.0:1789403130.432300:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630784 00000100:00100000:2.0:1789403130.432317:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789403130.432322:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050630784:12345-0@lo:503: 00000100:00100000:2.0:1789403130.433601:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050630784:12345-0@lo:503: Request processed in 1269us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403130.433616:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789403130.442597:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050630784:0@lo:503: 00000100:00100000:0.0:1789403130.442925:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8057:1876325050630912:0@lo:502: 00000100:00100000:0.0:1789403130.443194:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403130.443256:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050630912 00000100:00100000:0.0:1789403130.443264:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050630912 00000100:00100000:0.0:1789403130.443319:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403130.443330:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8057:x1876325050630912:12345-0@lo:502: 00000100:00100000:0.0:1789403130.443595:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8057:x1876325050630912:12345-0@lo:502: Request processed in 265us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403130.443603:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403130.443667:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2819dc600 going to sleep for 11 seconds 00000100:00100000:0.0:1789403130.443685:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8057:1876325050630912:0@lo:502: 00000020:01000000:0.0:1789403130.443777:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403130.443855:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403130.443858:0:8057:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789403130.443867:0:8057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a244ea0000 00000020:00000080:0.0:1789403130.443869:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789403130.443898:0:8057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8057:1876325050631040:0@lo:502: 00000100:00100000:0.0:1789403130.443932:0:8057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403130.444672:0:8057:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2819dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403130.444876:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631040 00000100:00100000:3.0:1789403130.444885:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631040 00000100:00100000:3.0:1789403130.445924:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403130.446013:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8057:x1876325050631040:12345-0@lo:502: 00000100:00100000:3.0:1789403130.446195:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8057:x1876325050631040:12345-0@lo:502: Request processed in 258us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403130.446204:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789403130.447086:0:8057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8057:1876325050631040:0@lo:502: 00000020:01000000:0.0:1789403130.447133:0:8057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403130.447142:0:8057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403130.447144:0:8057:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789403130.447149:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789403130.447363:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789403130.447761:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403130.447775:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403130.448008:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403131.127317:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050631168:0@lo:41: 00000100:00100000:2.0:1789403131.127476:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403131.128150:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631168 00000100:00100000:1.0:1789403131.128162:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631168 00000100:00100000:1.0:1789403131.128243:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789403131.128254:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050631168:12345-0@lo:41: 00000004:00000024:1.0:1789403131.128300:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789403131.128706:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050631168:12345-0@lo:41: Request processed in 453us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403131.128714:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789403131.128789:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050631168:0@lo:41: 00010000:00010000:2.0:1789403131.380670:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403132.403011:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403133.432134:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403134.464844:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403135.217991:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050631296:0@lo:41: 00000100:00100000:2.0:1789403135.218064:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403135.218176:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631296 00000100:00100000:3.0:1789403135.218184:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631296 00000100:00100000:3.0:1789403135.218247:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403135.218257:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050631296:12345-0@lo:41: 00000004:00000024:3.0:1789403135.218287:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789403135.218336:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050631296:12345-0@lo:41: Request processed in 80us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403135.218342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403135.218408:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050631296:0@lo:41: 00000100:00100000:1.0:1789403135.225805:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050631424:0@lo:400: 00000100:00100000:1.0:1789403135.225875:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403135.225920:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403135.225928:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050631552:0@lo:400: 00000100:00100000:1.0:1789403135.225957:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403135.225987:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050631680:0@lo:400: 00000100:00100000:1.0:1789403135.226011:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403135.226027:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403135.226032:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050631808:0@lo:400: 00000100:00100000:1.0:1789403135.226051:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403135.226090:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631424 00000100:00100000:1.0:1789403135.226097:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631424 00000100:00100000:1.0:1789403135.226138:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403135.226147:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:3626:x1876325050631424:12345-0@lo:400: 00000100:00100000:1.0:1789403135.226203:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:3626:x1876325050631424:12345-0@lo:400: Request processed in 57us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403135.226210:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403135.226239:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631552 00000100:00100000:1.0:1789403135.226243:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631552 00000100:00100000:1.0:1789403135.226265:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631808 00000100:00100000:1.0:1789403135.226268:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631808 00000100:00100000:1.0:1789403135.226296:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403135.226302:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050631552:12345-0@lo:400: 00000100:00100000:1.0:1789403135.226333:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050631552:12345-0@lo:400: Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403135.226339:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403135.226350:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403135.226355:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050631808:12345-0@lo:400: 00000100:00100000:1.0:1789403135.226383:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050631808:12345-0@lo:400: Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403135.226409:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789403135.226450:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a27a742680 x1876325050631552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403135.226464:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050631552:0@lo:400: 00000100:00100000:1.0:1789403135.226473:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050631424:0@lo:400: 00010000:00080000:1.0:1789403135.226499:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a27a741f80 x1876325050631808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403135.226506:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050631808:0@lo:400: 00000100:00100000:1.0:1789403135.226519:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631680 00000100:00100000:1.0:1789403135.226523:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631680 00000100:00100000:1.0:1789403135.226546:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789403135.226551:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050631680:12345-0@lo:400: 00000100:00100000:1.0:1789403135.226585:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050631680:12345-0@lo:400: Request processed in 34us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403135.226591:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789403135.226615:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050631680:0@lo:400: 00010000:00010000:2.0:1789403135.473512:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403136.247900:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050631936:0@lo:41: 00000100:00100000:0.0:1789403136.247969:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403136.248043:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050631936 00000100:00100000:0.0:1789403136.248050:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050631936 00000100:00100000:0.0:1789403136.248094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403136.248103:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050631936:12345-0@lo:41: 00000004:00000024:0.0:1789403136.248133:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789403136.248196:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050631936:12345-0@lo:41: Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403136.248216:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403136.248263:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050631936:0@lo:41: 00010000:00010000:3.0:1789403136.497807:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789403137.172021:0:8408:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789403137.172025:0:8408:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789403137.172027:0:8408:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789403137.172185:0:8408:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a27b560000 00000020:01000004:0.0:1789403137.172200:0:8408:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789403137.172213:0:8408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789403137.172226:0:8408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a281873380) 00000020:00000080:0.0:1789403137.172241:0:8408:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789403137.234500:0:8408:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789403137.234578:0:8408:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789403137.264349:0:8408:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789403137.266295:0:8408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789403137.266308:0:8408:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789403137.266319:0:8408:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb08b1e5b7608fc 00000020:01000004:2.0:1789403137.266327:0:8408:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789403137.266348:0:8408:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789403137.266352:0:8408:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789403137.266358:0:8408:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789403137.266363:0:8408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789403137.266377:0:8408:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a27c3619c0) 00000020:00000080:2.0:1789403137.266413:0:8408:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789403137.272038:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403137.272748:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789403137.272756:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789403137.276736:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789403137.276758:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789403137.278776:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789403137.278788:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789403137.285127:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403137.285630:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789403137.285638:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789403137.287744:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789403137.287756:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789403137.333776:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403137.335857:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789403137.335866:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789403137.338468:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789403137.338480:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789403137.339166:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789403137.339279:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789403137.342776:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789403137.342968:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789403137.342974:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789403137.343917:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789403137.343927:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789403137.407669:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403137.407875:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789403137.407882:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789403137.412763:0:8408:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789403137.412776:0:8408:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789403137.413898:0:8408:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789403137.413930:0:8408:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789403137.413937:0:8408:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789403137.430256:0:8408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789403137.430296:0:8408:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789403137.430300:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789403137.430302:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403137.430303:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403137.430304:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403137.430305:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403137.430307:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403137.430308:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403137.430309:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403137.430310:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403137.430312:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403137.430314:0:8408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403137.430317:0:8408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789403137.430320:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403137.430321:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403137.430322:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403137.430323:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403137.430324:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403137.430325:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403137.430326:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403137.430326:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403137.430327:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403137.430328:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403137.430329:0:8408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403137.430361:0:8408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789403137.430382:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050632064:0@lo:253: 00000100:00100000:1.0:1789403137.430645:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.430733:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.430772:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632064 00000100:00100000:0.0:1789403137.430780:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632064 00000100:00100000:0.0:1789403137.430856:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789403137.430866:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8408:x1876325050632064:12345-0@lo:253: 20000000:01000000:0.0:1789403137.430894:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789403137.430898:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789403137.430904:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789403137.430914:0:6492:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789403137.431119:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403137.431279:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789403137.431293:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789403137.431310:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789403137.431317:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789403137.431331:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789403137.431345:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789403137.431448:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789403137.431462:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1789403137.431464:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789403137.431476:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789403137.431482:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789403137.431493:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789403137.431498:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1789403137.431509:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789403137.431515:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789403137.431526:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789403137.431539:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789403137.431603:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1789403137.431614:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1789403137.431615:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789403137.431628:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1789403137.431633:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789403137.431645:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1789403137.431649:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1789403137.431662:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1789403137.431667:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789403137.431680:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1789403137.431695:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1789403137.432056:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1789403137.432078:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:0.0:1789403137.432080:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789403137.432095:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1789403137.432101:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789403137.432112:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1789403137.432117:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:0.0:1789403137.432145:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1789403137.432152:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789403137.432166:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1789403137.432194:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1789403137.432208:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789403137.432211:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789403137.432214:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789403137.432267:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789403137.432269:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789403137.434986:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1789403137.435034:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1789403137.435054:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789403137.435283:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1789403137.435305:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1789403137.435320:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1789403137.435333:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789403137.435335:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789403137.435711:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789403137.435833:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789403137.435853:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789403137.435870:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789403137.435879:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789403137.435881:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789403137.437734:0:8429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789403137.437780:0:8429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789403137.437799:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1789403137.438008:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1789403137.438030:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1789403137.438045:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1789403137.438055:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789403137.438057:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789403137.438840:0:8430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1789403137.438868:0:8430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1789403137.438884:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789403137.439073:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789403137.439098:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789403137.439114:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1789403137.439130:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789403137.439149:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439167:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439183:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439190:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439197:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439204:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439211:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439248:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439270:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 18 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.439285:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632192:0@lo:104: 00000100:00100000:3.0:1789403137.439349:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403137.439485:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632192 00000100:00100000:2.0:1789403137.439492:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632192 00000100:00100000:2.0:1789403137.439542:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403137.439552:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050632192:12345-0@lo:104: 00010000:00010000:2.0:1789403137.439565:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.439612:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403137.439618:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050632192:12345-0@lo:104: Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.439625:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789403137.439721:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439730:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 18 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.439739:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632320:0@lo:104: 00000100:00100000:3.0:1789403137.439760:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403137.439793:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439801:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 18 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.439810:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281838e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632448:0@lo:104: 00000100:00100000:3.0:1789403137.439832:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403137.439904:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.439912:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 18 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.439921:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632576:0@lo:104: 00000100:00100000:3.0:1789403137.439959:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403137.440005:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403137.440012:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440019:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a240031200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403137.440023:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440032:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403137.440039:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403137.440045:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403137.440075:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440082:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403137.440099:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440106:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a240031200/0x5fb08b1e5b7608bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608c4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440117:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403137.440119:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403137.440121:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403137.440139:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050632704:0@lo:103: 00000100:00100000:0.0:1789403137.440167:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403137.440215:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632704 00000100:00100000:0.0:1789403137.440226:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632704 00010000:00010000:0.0:1789403137.440244:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 19 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403137.440264:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403137.440270:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3627:x1876325050632704:12345-0@lo:103: 00010000:00010000:0.0:1789403137.440279:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403137.440283:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 19 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440292:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 19 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.440305:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403137.440331:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3627:x1876325050632704:12345-0@lo:103: Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.440337:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403137.440371:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050632704:0@lo:103: 00010000:00010000:3.0:1789403137.442130:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.442147:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 18 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.442160:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632832:0@lo:104: 00000100:00100000:3.0:1789403137.442215:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.442743:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632320 00000100:00100000:1.0:1789403137.442751:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632320 00000100:00100000:2.0:1789403137.442892:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632448 00000100:00100000:2.0:1789403137.442898:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632448 00000100:00100000:2.0:1789403137.442949:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632576 00000100:00100000:2.0:1789403137.442953:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632576 00000100:00100000:2.0:1789403137.442969:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403137.442977:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6492:x1876325050632448:12345-0@lo:104: 00010000:00010000:2.0:1789403137.442992:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.443064:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403137.443096:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6492:x1876325050632448:12345-0@lo:104: Request processed in 120us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.443104:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403137.443121:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403137.443128:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6492:x1876325050632576:12345-0@lo:104: 00010000:00010000:2.0:1789403137.443136:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.443326:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403137.443333:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6492:x1876325050632576:12345-0@lo:104: Request processed in 206us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.443339:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403137.443353:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403137.443359:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050632320:12345-0@lo:104: 00010000:00010000:2.0:1789403137.443367:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.443449:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789403137.443456:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.443463:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a27800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403137.443467:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.443475:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403137.443482:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403137.443488:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403137.443558:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403137.443717:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403137.443725:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.443732:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403137.443735:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.443741:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403137.443758:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403137.443763:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403137.443793:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789403137.443800:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050632320:12345-0@lo:104: Request processed in 442us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.443806:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789403137.443854:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.443861:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403137.443876:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.443883:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a27800/0x5fb08b1e5b76087e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760885 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.443896:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.443898:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.443906:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403137.443922:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050632960:0@lo:103: 00000100:00100000:1.0:1789403137.443971:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403137.444091:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.444098:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403137.444114:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.444121:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a241515e00/0x5fb08b1e5b760846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76084d expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.444133:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403137.444135:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403137.444136:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403137.444273:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050633088:0@lo:103: 00000100:00100000:1.0:1789403137.444300:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.444334:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632960 00000100:00100000:1.0:1789403137.444339:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632960 00010000:00010000:1.0:1789403137.444359:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 19 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.444385:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633088 00000100:00100000:1.0:1789403137.444415:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633088 00010000:00010000:1.0:1789403137.444429:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 20 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.444448:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403137.444455:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3628:x1876325050632960:12345-0@lo:103: 00010000:00010000:1.0:1789403137.444465:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403137.444469:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 20 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.444479:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 20 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.444494:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403137.444522:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3628:x1876325050632960:12345-0@lo:103: Request processed in 68us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.444528:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403137.444543:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403137.444549:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3629:x1876325050633088:12345-0@lo:103: 00010000:00010000:1.0:1789403137.444562:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403137.444567:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 19 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.444574:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 19 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.444583:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403137.444608:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3629:x1876325050633088:12345-0@lo:103: Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.444614:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403137.444648:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050632960:0@lo:103: 00000100:00100000:1.0:1789403137.444674:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050633088:0@lo:103: 00000100:00100000:3.0:1789403137.444860:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789403137.444875:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b7608c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7608bd expref: 18 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.444886:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632192:0@lo:104: 00000100:00100000:3.0:1789403137.444895:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632320:0@lo:104: 00010000:00010000:3.0:1789403137.444903:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76087e expref: 17 pid: 6492 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.444911:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281838e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632448:0@lo:104: 00010000:00010000:3.0:1789403137.444919:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b76084d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760846 expref: 16 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.444933:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632576:0@lo:104: 00000100:00100000:2.0:1789403137.445286:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050632832 00000100:00100000:2.0:1789403137.445292:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050632832 00000100:00100000:2.0:1789403137.445314:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403137.445320:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050632832:12345-0@lo:104: 00010000:00010000:2.0:1789403137.445332:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.445414:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403137.445420:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6492:x1876325050632832:12345-0@lo:104: Request processed in 100us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.445427:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403137.445500:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876325050632832:0@lo:104: 00010000:00010000:1.0:1789403137.445525:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.445541:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403137.445546:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.445553:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403137.445556:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.445564:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403137.445580:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403137.445586:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403137.445621:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.445628:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403137.445767:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403137.445769:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403137.445771:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403137.445802:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.445809:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a240031c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403137.445813:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.445820:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403137.445827:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403137.445833:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403137.445858:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.445864:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789403137.446052:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050633216:0@lo:103: 00000100:00100000:0.0:1789403137.446094:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403137.446132:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403137.446139:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050633344:0@lo:103: 00000100:00100000:0.0:1789403137.446162:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403137.446197:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633216 00000100:00100000:0.0:1789403137.446202:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633216 00010000:00010000:0.0:1789403137.446222:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 16 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403137.446243:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633344 00000100:00100000:0.0:1789403137.446246:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633344 00010000:00010000:0.0:1789403137.446266:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 17 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403137.446284:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403137.446290:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:3626:x1876325050633216:12345-0@lo:103: 00010000:00010000:0.0:1789403137.446301:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403137.446305:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 17 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446313:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 17 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446325:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b7607d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7607cf expref: 17 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446336:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403137.446364:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3626:x1876325050633216:12345-0@lo:103: Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.446371:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403137.446385:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403137.446416:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a606c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3626:x1876325050633344:12345-0@lo:103: 00010000:00010000:0.0:1789403137.446424:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403137.446428:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 15 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446437:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 15 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446447:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946000/0x5fb08b1e5b7608a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76089a expref: 15 pid: 6495 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446468:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446476:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446491:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446498:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446505:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446512:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446518:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403137.446522:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446530:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446545:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446555:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403137.446579:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a606c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:3626:x1876325050633344:12345-0@lo:103: Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.446593:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789403137.446640:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446647:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.446654:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185800/0x5fb08b1e5b76090a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789403137.446666:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789403137.446985:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050633344:0@lo:103: 00000100:00100000:0.0:1789403137.446993:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050633216:0@lo:103: 00010000:00010000:2.0:1789403137.447689:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.447701:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a240031c00/0x5fb08b1e5b76089a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608a1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.447716:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403137.447724:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403137.447726:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.448204:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.448215:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1c00/0x5fb08b1e5b7607cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7607d6 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.448464:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.448467:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.448469:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403137.449157:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:8408:x1876325050632064:12345-0@lo:253: Request processed in 18288us (18508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.449169:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789403137.449250:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050632064:0@lo:253: 10000000:01000000:1.0:1789403137.449264:0:8408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789403137.449267:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789403137.449268:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403137.449270:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403137.449271:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789403137.449273:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403137.449274:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403137.449275:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403137.449276:0:8408:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789403137.449278:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403137.449279:0:8408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789403137.449299:0:8408:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a27b560000 from lustre-OST0000 10000000:01000000:1.0:1789403137.449327:0:8408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789403137.449338:0:8408:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789403137.449346:0:8408:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a245c9b380 local copy 10000000:01000000:1.0:1789403137.449350:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789403137.449380:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.449566:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.449576:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403137.449682:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633472:0@lo:101: 00000100:00100000:0.0:1789403137.449715:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403137.449781:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403137.449816:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633472 00000100:00100000:1.0:1789403137.449822:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633472 00000100:00100000:1.0:1789403137.449992:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789403137.450002:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+13:8408:x1876325050633472:12345-0@lo:101: 00010000:00010000:1.0:1789403137.450014:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403137.450026:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760911 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.450047:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760911 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.450057:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760911 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.450065:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27800, rc 0) 00000100:00100000:1.0:1789403137.450141:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050633472:12345-0@lo:101: Request processed in 140us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.450148:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789403137.450207:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633472:0@lo:101: 00010000:00010000:3.0:1789403137.450221:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.450240:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.450337:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633600:0@lo:501: 00000100:00100000:3.0:1789403137.450366:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.450611:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.450680:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633600 00000100:00100000:0.0:1789403137.450686:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633600 00000100:00100000:0.0:1789403137.450712:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789403137.450718:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050633600:12345-0@lo:501: 00000100:00100000:0.0:1789403137.450786:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050633600:12345-0@lo:501: Request processed in 67us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789403137.450792:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789403137.450859:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633600:0@lo:501: 10000000:01000000:3.0:1789403137.450874:0:8408:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789403137.450902:0:8408:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789403137.450908:0:8408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.450916:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.451013:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.451037:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789403137.451060:0:8408:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a27b560000 10000000:01000000:3.0:1789403137.451066:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789403137.451072:0:8408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789403137.451074:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403137.451078:0:8408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789403137.451081:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789403137.451099:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.451118:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.451128:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.451142:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633728:0@lo:101: 00000100:00100000:3.0:1789403137.451169:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.451194:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00010000:00010000:0.0:1789403137.451243:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403137.451255:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451262:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a26400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403137.451265:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451273:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403137.451280:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403137.451285:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403137.451304:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451310:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403137.451327:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451334:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b760918 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451345:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403137.451347:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403137.451349:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403137.451358:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633728 00000100:00100000:0.0:1789403137.451362:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633728 00000100:00100000:0.0:1789403137.451380:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789403137.451419:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050633728:12345-0@lo:101: 00010000:00010000:0.0:1789403137.451437:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403137.451447:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76091f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451462:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451471:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451478:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1200, rc 0) 00000100:00100000:0.0:1789403137.451505:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050633728:12345-0@lo:101: Request processed in 118us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.451511:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789403137.451579:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050633856:0@lo:103: 00000100:00100000:1.0:1789403137.451614:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403137.451695:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633856 00000100:00100000:0.0:1789403137.451699:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633856 00000100:00100000:0.0:1789403137.451734:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403137.451742:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3628:x1876325050633856:12345-0@lo:103: 00010000:00010000:0.0:1789403137.451750:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403137.451760:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760911 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.451769:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403137.451796:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:3628:x1876325050633856:12345-0@lo:103: Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.451802:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403137.451864:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633728:0@lo:101: 00010000:00010000:3.0:1789403137.451876:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.451895:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.452060:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633984:0@lo:501: 00000100:00100000:3.0:1789403137.452102:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.452123:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.452171:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050633984 00000100:00100000:0.0:1789403137.452185:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050633984 00000100:00100000:0.0:1789403137.452215:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789403137.452227:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050633984:12345-0@lo:501: 00000100:00100000:0.0:1789403137.452314:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050633984:12345-0@lo:501: Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.452321:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789403137.452422:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050633856:0@lo:103: 00000100:00100000:3.0:1789403137.452526:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050633984:0@lo:501: 00000100:00100000:3.0:1789403137.452564:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634112:0@lo:503: 00000100:00100000:3.0:1789403137.452601:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.452629:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.452671:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634112 00000100:00100000:0.0:1789403137.452675:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634112 00000100:00100000:0.0:1789403137.452702:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789403137.452709:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634112:12345-0@lo:503: 00000100:00100000:0.0:1789403137.452790:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634112:12345-0@lo:503: Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.452797:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789403137.452864:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634112:0@lo:503: 00000040:00080000:1.0:1789403137.453264:0:8408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789403137.453336:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634240:0@lo:502: 00000100:00100000:1.0:1789403137.453373:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.453424:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.453501:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634240 00000100:00100000:0.0:1789403137.453507:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634240 00000100:00100000:0.0:1789403137.453527:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789403137.453533:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634240:12345-0@lo:502: 00000100:00100000:0.0:1789403137.453607:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634240:12345-0@lo:502: Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.453614:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789403137.453728:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634240:0@lo:502: 00000040:00080000:1.0:1789403137.454035:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789403137.454064:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789403137.454081:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789403137.454098:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789403137.454113:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789403137.454126:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789403137.454147:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634368:0@lo:502: 00000100:00100000:1.0:1789403137.454192:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.454223:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.454279:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634368 00000100:00100000:0.0:1789403137.454284:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634368 00000100:00100000:0.0:1789403137.454314:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789403137.454321:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634368:12345-0@lo:502: 00000100:00100000:0.0:1789403137.454410:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634368:12345-0@lo:502: Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.454416:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403137.454529:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634368:0@lo:502: 00000040:00080000:1.0:1789403137.454566:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789403137.454573:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789403137.455250:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403137.455259:0:8433:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789403137.455266:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403137.455268:0:8433:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789403137.455274:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403137.455289:0:8433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a245c98000) 00000020:00000080:1.0:1789403137.455310:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789403137.455323:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789403137.455530:0:8433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a27b560000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789403137.455538:0:8433:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789403137.455545:0:8433:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb08b1e5b760934 00010000:00010000:0.0:1789403137.461220:0:8433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789403137.461644:0:8433:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789403137.465350:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789403137.465897:0:8433:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789403137.471029:0:8433:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789403137.471751:0:8433:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789403137.478732:0:8433:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789403137.483299:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789403137.483312:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403137.483319:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403137.483321:0:8433:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789403137.483324:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403137.483329:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403137.483330:0:8433:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789403137.483333:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789403137.483335:0:8433:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789403137.483363:0:8433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403137.483367:0:8433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403137.483368:0:8433:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789403137.483371:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789403137.483596:0:8408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789403137.483625:0:8408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789403137.483648:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.483661:0:8408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403137.483670:0:8408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a27b560000 from 1 10000000:01000000:1.0:1789403137.483673:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403137.483710:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.483718:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.483729:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.483754:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634496:0@lo:101: 00000100:00100000:1.0:1789403137.483821:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.483858:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a24568c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.483951:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634496 00000100:00100000:0.0:1789403137.483958:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634496 00000100:00100000:0.0:1789403137.484001:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789403137.484010:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:8408:x1876325050634496:12345-0@lo:101: 00010000:00010000:0.0:1789403137.484021:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403137.484032:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76093b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.484053:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.484063:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.484071:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0200, rc 0) 00000100:00100000:0.0:1789403137.484109:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634496:12345-0@lo:101: Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.484115:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403137.484310:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634496:0@lo:101: 00010000:00010000:1.0:1789403137.484322:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.484330:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.484469:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634624:0@lo:501: 00000100:00100000:1.0:1789403137.484494:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.484519:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634624 00000100:00100000:1.0:1789403137.484523:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634624 00000100:00100000:1.0:1789403137.484560:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403137.484567:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634624:12345-0@lo:501: 00000100:00100000:1.0:1789403137.484652:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634624:12345-0@lo:501: Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.484659:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403137.484687:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a24568c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403137.484700:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634624:0@lo:501: 00000100:00100000:1.0:1789403137.484724:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634752:0@lo:503: 00000100:00100000:1.0:1789403137.484760:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.484772:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a24568c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.484849:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634752 00000100:00100000:0.0:1789403137.484853:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634752 00000100:00100000:0.0:1789403137.484881:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789403137.484889:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634752:12345-0@lo:503: 00000100:00100000:0.0:1789403137.484978:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634752:12345-0@lo:503: Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.484994:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789403137.485128:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634752:0@lo:503: 00000040:00080000:1.0:1789403137.485377:0:8408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789403137.485481:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634880:0@lo:502: 00000100:00100000:1.0:1789403137.485517:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.485536:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.485635:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050634880 00000100:00100000:0.0:1789403137.485641:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050634880 00000100:00100000:0.0:1789403137.485673:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789403137.485681:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634880:12345-0@lo:502: 00000100:00100000:0.0:1789403137.485765:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050634880:12345-0@lo:502: Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.485771:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789403137.486313:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050634880:0@lo:502: 00000040:00080000:1.0:1789403137.486563:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789403137.486590:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789403137.486613:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635008:0@lo:502: 00000100:00100000:1.0:1789403137.486657:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.486690:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262900 going to sleep for 11 seconds 00000100:00100000:2.0:1789403137.486749:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635008 00000100:00100000:2.0:1789403137.486756:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635008 00000100:00100000:2.0:1789403137.486785:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789403137.486792:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050635008:12345-0@lo:502: 00000100:00100000:2.0:1789403137.486876:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050635008:12345-0@lo:502: Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.486892:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789403137.487245:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635008:0@lo:502: 00000040:00080000:1.0:1789403137.487286:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789403137.487294:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789403137.487787:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403137.487797:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403137.487799:0:8436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789403137.487805:0:8436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a27b560000 00000020:00000080:0.0:1789403137.487807:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403137.487818:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403137.487821:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403137.487822:0:8436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789403137.487825:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789403137.488067:0:8408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789403137.488087:0:8408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403137.488106:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.488117:0:8408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403137.488238:0:8408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789403137.488242:0:8408:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a27b560000 10000000:01000000:1.0:1789403137.488245:0:8408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a27b560000 10000000:01000000:1.0:1789403137.488250:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403137.488257:0:8408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a27b560000 from 1 10000000:01000000:1.0:1789403137.488260:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403137.488288:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.488296:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.488307:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.488325:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635136:0@lo:101: 00000100:00100000:1.0:1789403137.488368:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.488525:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262240 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.490818:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635136 00000100:00100000:0.0:1789403137.490830:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635136 00000100:00100000:0.0:1789403137.490918:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789403137.490938:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8408:x1876325050635136:12345-0@lo:101: 00010000:00010000:0.0:1789403137.490953:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403137.490969:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760949 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.490994:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.491004:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403137.491020:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1c00, rc 0) 00000100:00100000:0.0:1789403137.491090:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635136:12345-0@lo:101: Request processed in 154us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403137.491096:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789403137.491437:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635136:0@lo:101: 00010000:00010000:3.0:1789403137.491456:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.491472:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.491588:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635264:0@lo:501: 00000100:00100000:3.0:1789403137.491618:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.496324:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403137.496372:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635264 00000100:00100000:1.0:1789403137.496382:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635264 00000100:00100000:1.0:1789403137.496573:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789403137.496583:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635264:12345-0@lo:501: 00000100:00100000:1.0:1789403137.496752:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635264:12345-0@lo:501: Request processed in 170us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.496760:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789403137.496860:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635264:0@lo:501: 00000100:00100000:3.0:1789403137.496916:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635392:0@lo:503: 00000100:00100000:3.0:1789403137.496976:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.497299:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403137.497346:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635392 00000100:00100000:2.0:1789403137.497351:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635392 00000100:00100000:2.0:1789403137.497376:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789403137.497383:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635392:12345-0@lo:503: 00000100:00100000:2.0:1789403137.497553:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635392:12345-0@lo:503: Request processed in 169us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.497560:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789403137.497635:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635392:0@lo:503: 00000040:00080000:3.0:1789403137.497877:0:8408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403137.498064:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635520:0@lo:502: 00000100:00100000:3.0:1789403137.498096:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.498120:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403137.498167:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635520 00000100:00100000:2.0:1789403137.498187:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635520 00000100:00100000:2.0:1789403137.498207:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789403137.498213:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635520:12345-0@lo:502: 00000100:00100000:2.0:1789403137.498289:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635520:12345-0@lo:502: Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.498296:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789403137.498430:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635520:0@lo:502: 00000040:00080000:3.0:1789403137.498671:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789403137.498698:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789403137.498715:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789403137.498729:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789403137.498743:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789403137.498765:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789403137.498778:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789403137.498789:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789403137.498802:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789403137.498816:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789403137.498840:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789403137.498855:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789403137.498870:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789403137.498883:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789403137.498908:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789403137.499039:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789403137.499057:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789403137.499069:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789403137.499080:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789403137.499094:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789403137.499109:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789403137.499135:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789403137.499165:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789403137.499193:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789403137.499210:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789403137.499226:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789403137.499241:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789403137.499257:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789403137.499270:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789403137.499283:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789403137.499295:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789403137.499307:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789403137.499320:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789403137.499334:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789403137.499348:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789403137.499363:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789403137.499376:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789403137.499434:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635648:0@lo:502: 00000100:00100000:3.0:1789403137.499481:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.499503:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403137.499625:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635648 00000100:00100000:2.0:1789403137.499631:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635648 00000100:00100000:2.0:1789403137.499659:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789403137.499666:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635648:12345-0@lo:502: 00000100:00100000:2.0:1789403137.499753:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050635648:12345-0@lo:502: Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.499761:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789403137.500064:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050635648:0@lo:502: 00000040:00080000:3.0:1789403137.500119:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789403137.500128:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789403137.500722:0:8438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789403137.500737:0:8438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a281ae3380) 00000020:00000080:3.0:1789403137.500758:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789403137.500840:0:8438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a27b560000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789403137.500844:0:8438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a27b560000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789403137.500847:0:8438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a27b560000 3 00010000:00080000:3.0:1789403137.500881:0:8438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1421c3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403137.504161:0:8438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789403137.504423:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789403137.504469:0:8438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403137.504483:0:8438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5fb08b1e5b76095e 00000100:00080000:3.0:1789403137.504494:0:8438:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403137.504506:0:8438:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a1421c3000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403137.504542:0:8438:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aafb80 x1876325050635776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403137.504561:0:8438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789403137.504658:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050635904:0@lo:400: 00000100:00100000:3.0:1789403137.504723:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.504760:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403137.504766:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050636288:0@lo:400: 00000100:00100000:3.0:1789403137.504793:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.504829:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050636032:0@lo:400: 00000100:00100000:3.0:1789403137.504851:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.504869:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403137.504874:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050636160:0@lo:400: 00000100:00100000:3.0:1789403137.504914:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.504951:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635904 00000100:00100000:3.0:1789403137.504959:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635904 00000100:00100000:3.0:1789403137.504999:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636160 00000100:00100000:3.0:1789403137.505003:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636160 00000100:00100000:3.0:1789403137.505018:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403137.505026:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050635904:12345-0@lo:400: 00000100:00100000:3.0:1789403137.505076:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050635904:12345-0@lo:400: Request processed in 49us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403137.505082:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403137.505096:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403137.505102:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050636160:12345-0@lo:400: 00000100:00100000:3.0:1789403137.505132:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050636160:12345-0@lo:400: Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403137.505138:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403137.505156:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636288 00000100:00100000:3.0:1789403137.505159:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636288 00000100:00100000:1.0:1789403137.509535:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050635776:0@lo:38: 00000100:00100000:1.0:1789403137.509610:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.509678:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050635776 00000100:00100000:1.0:1789403137.509686:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050635776 00000100:00100000:1.0:1789403137.509713:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403137.509720:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050635776:12345-0@lo:38: 00010000:00080000:1.0:1789403137.509746:0:6500:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1789403137.509786:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb08b1e5b760965 00000004:00100000:1.0:1789403137.509801:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403137.509833:0:6500:0:(import.c:65:import_set_state_nolock()) ffff90a142168000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403137.509882:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876325050635776:12345-0@lo:38: Request processed in 160us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.509889:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789403137.509941:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aafb80 x1876325050635776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403137.509951:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789403137.509959:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789403137.509966:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789403137.509970:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789403137.509973:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1421c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789403137.509987:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050635776:0@lo:38: 00000100:00100000:3.0:1789403137.510106:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636032 00000100:00100000:3.0:1789403137.510111:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636032 00000100:00100000:3.0:1789403137.510134:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403137.510141:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050636288:12345-0@lo:400: 00000100:00100000:3.0:1789403137.510194:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050636288:12345-0@lo:400: Request processed in 53us (5400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403137.510200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403137.510214:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403137.510220:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050636032:12345-0@lo:400: 00000100:00100000:3.0:1789403137.510248:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050636032:12345-0@lo:400: Request processed in 29us (5396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403137.510261:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789403137.510306:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aac380 x1876325050636160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403137.510317:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050636160:0@lo:400: 00000100:00100000:3.0:1789403137.510328:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050636032:0@lo:400: 00000100:00100000:3.0:1789403137.510353:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050636288:0@lo:400: 00010000:00080000:3.0:1789403137.510366:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aaf480 x1876325050635904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403137.510375:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050635904:0@lo:400: 00000020:01000004:3.0:1789403137.510746:0:8438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789403137.510762:0:8438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90a281ae4d40) 00000020:00000080:3.0:1789403137.510778:0:8438:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789403137.510868:0:8438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a27b560000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789403137.510872:0:8438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a27b560000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789403137.510875:0:8438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a27b560000 3 00010000:00080000:3.0:1789403137.510928:0:8438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1421c0000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403137.516282:0:8438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789403137.516549:0:8438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789403137.516587:0:8438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403137.516598:0:8438:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5fb08b1e5b760973 00000100:00080000:3.0:1789403137.516609:0:8438:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403137.516621:0:8438:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90a1421c0000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403137.516655:0:8438:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaf480 x1876325050636416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403137.516688:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050636416:0@lo:38: 00000100:00100000:3.0:1789403137.516765:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.516824:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636416 00000100:00100000:3.0:1789403137.516831:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636416 00000100:00100000:3.0:1789403137.516863:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403137.516870:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050636416:12345-0@lo:38: 00010000:00080000:3.0:1789403137.516892:0:6500:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1789403137.517063:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5fb08b1e5b76097a 00000004:00100000:3.0:1789403137.517079:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789403137.517111:0:6500:0:(import.c:65:import_set_state_nolock()) ffff90a1421c2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403137.517167:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876325050636416:12345-0@lo:38: Request processed in 296us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403137.517184:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789403137.517201:0:8438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1789403137.517413:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aaf480 x1876325050636416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403137.517424:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403137.517433:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789403137.517439:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789403137.517444:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789403137.517445:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1421c0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403137.517452:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050636416:0@lo:38: 00010000:00010000:3.0:1789403137.526151:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403137.526226:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789403137.530832:0:8408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789403137.530879:0:8408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403137.530960:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.530974:0:8408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789403137.531031:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789403137.531034:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403137.531035:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403137.531036:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403137.531038:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403137.531039:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403137.531040:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403137.531042:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403137.531043:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403137.531045:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403137.531046:0:8408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403137.531050:0:8408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789403137.531052:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403137.531054:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403137.531055:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403137.531056:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403137.531057:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403137.531059:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403137.531060:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403137.531061:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789403137.531062:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789403137.531064:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403137.531065:0:8408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403137.531093:0:8408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789403137.531112:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050636544:0@lo:253: 00000100:00100000:1.0:1789403137.531194:0:8408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.531249:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403137.532424:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636544 00000100:00100000:0.0:1789403137.532436:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636544 00000100:00100000:0.0:1789403137.532482:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789403137.532491:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050636544:12345-0@lo:253: 20000000:01000000:0.0:1789403137.532519:0:6495:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789403137.532530:0:6495:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789403137.547183:0:6495:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789403137.547204:0:6495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789403137.547338:0:6515:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789403137.547343:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789403137.547365:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.547384:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.547416:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.547423:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.547461:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.547487:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 16 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.547502:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050636672:0@lo:104: 00000100:00100000:3.0:1789403137.547563:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403137.547606:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.547614:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 16 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403137.547622:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050636800:0@lo:104: 00000100:00100000:3.0:1789403137.547637:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403137.547698:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789403137.547715:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403137.547730:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636672 00000100:00100000:2.0:1789403137.547736:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636672 00000100:00100000:2.0:1789403137.547766:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636800 00000100:00100000:2.0:1789403137.547768:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636800 00000100:00100000:2.0:1789403137.547787:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789403137.547794:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6515:x1876325050636672:12345-0@lo:104: 00010000:00010000:2.0:1789403137.547805:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.547861:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403137.547866:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6515:x1876325050636672:12345-0@lo:104: Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.547872:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789403137.547905:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403137.547910:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050636800:12345-0@lo:104: 00010000:00010000:2.0:1789403137.547917:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403137.547942:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403137.547946:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050636800:12345-0@lo:104: Request processed in 37us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.547951:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403137.548103:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:8408:x1876325050636544:12345-0@lo:253: Request processed in 15613us (16909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403137.548111:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789403137.548210:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8408:1876325050636544:0@lo:253: 10000000:01000000:0.0:1789403137.548222:0:8408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789403137.548224:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789403137.548227:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789403137.548228:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403137.548229:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403137.548230:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403137.548231:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403137.548233:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403137.548234:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789403137.548236:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789403137.548237:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403137.548239:0:8408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789403137.548251:0:8408:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789403137.549327:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403137.549339:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549350:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a240030200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403137.549355:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549365:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403137.549374:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403137.549380:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403137.549441:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549447:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403137.549465:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549472:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a240030200/0x5fb08b1e5b76088c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760893 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549490:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403137.549494:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549500:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a27200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403137.549518:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549525:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403137.549532:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403137.549537:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403137.549553:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549559:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403137.549571:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549578:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a27200/0x5fb08b1e5b760870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760877 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.549593:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.549595:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.549597:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403137.549605:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403137.554031:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050636928:0@lo:103: 00000100:00100000:3.0:1789403137.554123:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403137.554206:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050637056:0@lo:103: 00000100:00100000:3.0:1789403137.554232:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403137.554266:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050636928 00000100:00100000:1.0:1789403137.554278:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050636928 00000100:00100000:3.0:1789403137.554294:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050636672:0@lo:104: 00000100:00100000:3.0:1789403137.554309:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050636800:0@lo:104: 00010000:00010000:1.0:1789403137.554319:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 16 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.554334:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.554354:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637056 00000100:00100000:1.0:1789403137.554359:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637056 00010000:00010000:1.0:1789403137.554373:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 17 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403137.554436:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403137.554445:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:3629:x1876325050636928:12345-0@lo:103: 00010000:00010000:1.0:1789403137.554460:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403137.554466:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 17 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554477:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 17 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554494:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76088c expref: 17 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554509:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403137.554546:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3629:x1876325050636928:12345-0@lo:103: Request processed in 102us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.554553:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403137.554569:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403137.554575:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3626:x1876325050637056:12345-0@lo:103: 00010000:00010000:1.0:1789403137.554583:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403137.554587:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 15 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554596:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 15 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554605:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b760877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760870 expref: 15 pid: 6493 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554628:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554636:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789403137.554649:0:7451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020350140s 00010000:00010000:1.0:1789403137.554654:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554661:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554668:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554675:0:7451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554681:0:7451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403137.554685:0:7451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554692:0:7451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554703:0:7451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403137.554711:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403137.554738:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:3626:x1876325050637056:12345-0@lo:103: Request processed in 163us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403137.554745:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789403137.555360:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050637056:0@lo:103: 00000100:00100000:3.0:1789403137.555403:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050636928:0@lo:103: 00010000:00010000:3.0:1789403137.555421:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.555439:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403137.555447:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760981 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789403137.559218:0:8408:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789403137.559409:0:8408:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789403137.559622:0:8408:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789403137.559820:0:8408:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789403137.560866:0:8408:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789403137.561104:0:8408:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789403137.563562:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789403137.585376:0:8408:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789403137.585549:0:8408:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789403137.585899:0:8408:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789403137.585947:0:8408:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789403137.585970:0:8408:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789403137.586006:0:8408:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789403137.586694:0:8408:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403137.586847:0:8408:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789403138.547796:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789403138.591811:0:8494:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403138.592385:0:8494:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789403139.443350:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789403139.443357:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a281b11800 from 30 10000000:01000000:0.0:1789403139.443361:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789403139.443431:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403139.443442:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403139.443452:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403139.443475:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637184:0@lo:101: 00000100:00100000:0.0:1789403139.443542:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.443591:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.443671:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637184 00000100:00100000:2.0:1789403139.443679:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637184 00000100:00100000:2.0:1789403139.443744:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789403139.443753:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:6497:x1876325050637184:12345-0@lo:101: 00010000:00010000:2.0:1789403139.443766:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403139.443778:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760988 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.443915:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.443926:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.443934:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946800, rc 0) 00000100:00100000:2.0:1789403139.443976:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050637184:12345-0@lo:101: Request processed in 224us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.443982:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789403139.444030:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637184:0@lo:101: 00010000:00010000:2.0:1789403139.444042:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.444051:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.444114:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637312:0@lo:501: 00000100:00100000:2.0:1789403139.444139:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.444173:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.444187:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637312 00000100:00100000:2.0:1789403139.444190:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637312 00000100:00100000:2.0:1789403139.444212:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789403139.444229:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050637312:12345-0@lo:501: 00000100:00100000:2.0:1789403139.444354:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050637312:12345-0@lo:501: Request processed in 127us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.444361:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789403139.444422:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637312:0@lo:501: 00000100:00100000:2.0:1789403139.444446:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637440:0@lo:503: 00000100:00100000:2.0:1789403139.444487:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.444506:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484f7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.444516:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637440 00000100:00100000:2.0:1789403139.444520:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637440 00000100:00100000:2.0:1789403139.444540:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789403139.444545:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050637440:12345-0@lo:503: 00000100:00100000:2.0:1789403139.444616:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050637440:12345-0@lo:503: Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.444622:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789403139.444663:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637440:0@lo:503: 00000100:00100000:3.0:1789403139.455770:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8545:1876325050637568:0@lo:502: 00000100:00100000:3.0:1789403139.455878:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.456128:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.456185:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637568 00000100:00100000:2.0:1789403139.456194:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637568 00000100:00100000:2.0:1789403139.456248:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403139.456258:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8545:x1876325050637568:12345-0@lo:502: 00000100:00100000:2.0:1789403139.456385:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8545:x1876325050637568:12345-0@lo:502: Request processed in 128us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.456426:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789403139.456535:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8545:1876325050637568:0@lo:502: 00000100:00100000:1.0:1789403139.456586:0:8545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8545:1876325050637696:0@lo:502: 00000100:00100000:1.0:1789403139.456621:0:8545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.456652:0:8545:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.456696:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637696 00000100:00100000:2.0:1789403139.456700:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637696 00000100:00100000:2.0:1789403139.456732:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789403139.456746:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8545:x1876325050637696:12345-0@lo:502: 00000100:00100000:2.0:1789403139.456823:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:8545:x1876325050637696:12345-0@lo:502: Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.457111:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789403139.457196:0:8545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8545:1876325050637696:0@lo:502: 00000040:00080000:1.0:1789403139.457217:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789403139.457503:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789403139.457525:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789403139.457535:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.457546:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403139.457556:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789403139.457559:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b11800 from 5 10000000:01000000:2.0:1789403139.457562:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789403139.457591:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.457600:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.457609:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.457627:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637824:0@lo:101: 00000100:00100000:2.0:1789403139.457662:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.457692:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a797000 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.457733:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637824 00000100:00100000:3.0:1789403139.457739:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637824 00000100:00100000:3.0:1789403139.457776:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789403139.457950:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050637824:12345-0@lo:101: 00010000:00010000:3.0:1789403139.457962:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403139.457976:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760996 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.457997:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.458008:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.458015:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184200, rc 0) 00000100:00100000:3.0:1789403139.458054:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050637824:12345-0@lo:101: Request processed in 273us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403139.458071:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789403139.458579:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637824:0@lo:101: 00010000:00010000:2.0:1789403139.458597:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.458613:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.458666:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637952:0@lo:256: 00000100:00100000:2.0:1789403139.458700:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.458728:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a797000 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.458785:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050637952 00000100:00100000:3.0:1789403139.458801:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050637952 00000100:00100000:2.0:1789403139.459016:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789403139.459025:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050637952:12345-0@lo:256: 20000000:01000000:2.0:1789403139.459041:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789403139.459058:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789403139.459062:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789403139.459474:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050637952:12345-0@lo:256: Request processed in 449us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.459483:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789403139.459567:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050637952:0@lo:256: 10000000:01000000:0.0:1789403139.459614:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403139.459621:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403139.459629:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403139.459637:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789403139.459640:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789403139.459648:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789403139.459672:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403139.459679:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403139.459687:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403139.459701:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050638080:0@lo:101: 00000100:00100000:0.0:1789403139.459730:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.459763:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.459813:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638080 00000100:00100000:2.0:1789403139.459817:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638080 00000100:00100000:2.0:1789403139.459860:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789403139.459867:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050638080:12345-0@lo:101: 00010000:00010000:2.0:1789403139.459875:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403139.459896:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7609a4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.459915:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.459923:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.459940:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946e00, rc 0) 00000100:00100000:2.0:1789403139.459969:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050638080:12345-0@lo:101: Request processed in 103us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.459975:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789403139.460098:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050638080:0@lo:101: 00010000:00010000:0.0:1789403139.460111:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403139.460120:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403139.460183:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050638208:0@lo:501: 00000100:00100000:0.0:1789403139.460207:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.460225:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.460317:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638208 00000100:00100000:2.0:1789403139.460322:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638208 00000100:00100000:2.0:1789403139.460349:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789403139.460355:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050638208:12345-0@lo:501: 00000100:00100000:2.0:1789403139.460496:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050638208:12345-0@lo:501: Request processed in 141us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.460502:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789403139.460579:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050638208:0@lo:501: 00000100:00100000:0.0:1789403139.460605:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050638336:0@lo:503: 00000100:00100000:0.0:1789403139.460644:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.460672:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.461038:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638336 00000100:00100000:2.0:1789403139.461043:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638336 00000100:00100000:2.0:1789403139.461079:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789403139.461086:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050638336:12345-0@lo:503: 00000100:00100000:2.0:1789403139.461188:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050638336:12345-0@lo:503: Request processed in 102us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.461194:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789403139.461271:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050638336:0@lo:503: 00000100:00100000:0.0:1789403139.462267:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8546:1876325050638464:0@lo:502: 00000100:00100000:0.0:1789403139.462319:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.462357:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797480 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.462426:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638464 00000100:00100000:2.0:1789403139.462432:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638464 00000100:00100000:2.0:1789403139.462465:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789403139.462474:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8546:x1876325050638464:12345-0@lo:502: 00000100:00100000:2.0:1789403139.462576:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8546:x1876325050638464:12345-0@lo:502: Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.462583:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789403139.462691:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8546:1876325050638464:0@lo:502: 00000020:01000000:3.0:1789403139.462719:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789403139.462727:0:8546:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789403139.462733:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.462735:0:8546:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789403139.462740:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403139.462744:0:8546:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:3.0:1789403139.462766:0:8546:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789403139.462768:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403139.462795:0:8546:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90a281ae0000) 00000020:00000080:3.0:1789403139.462816:0:8546:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789403139.462821:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403139.462901:0:8546:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789403139.462907:0:8546:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789403139.462914:0:8546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b7609b9 00010000:00080000:3.0:1789403139.462938:0:8546:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1421c7000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403139.463176:0:8546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789403139.487053:0:8546:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789403139.487077:0:8546:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789403139.487331:0:8546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403139.487625:0:8546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403139.487712:0:8546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789403139.487799:0:8546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789403139.488295:0:8549:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403139.488300:0:8549:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789403139.490506:0:8546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403139.490519:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789403139.490561:0:8546:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789403139.490585:0:8546:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7609c0 00000100:00080000:3.0:1789403139.490596:0:8546:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403139.490607:0:8546:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a1421c7000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403139.490644:0:8546:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaed80 x1876325050638592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403139.490676:0:8546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789403139.490742:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403139.490746:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.490748:0:8546:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789403139.490751:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403139.490755:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.490757:0:8546:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403139.490760:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403139.490761:0:8546:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789403139.491130:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050638848:0@lo:400: 00000100:00100000:1.0:1789403139.491219:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.491262:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050639360:0@lo:400: 00000100:00100000:1.0:1789403139.491284:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.491307:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403139.491313:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050639232:0@lo:400: 00000100:00100000:1.0:1789403139.491337:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.491366:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050638976:0@lo:400: 00000100:00100000:1.0:1789403139.491407:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.491426:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050639488:0@lo:400: 00000100:00100000:1.0:1789403139.491457:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.491474:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403139.491480:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050639104:0@lo:400: 00000100:00100000:1.0:1789403139.491517:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.491543:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638848 00000100:00100000:1.0:1789403139.491628:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638848 00000100:00100000:1.0:1789403139.491666:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639360 00000100:00100000:1.0:1789403139.491669:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639360 00000100:00100000:1.0:1789403139.491686:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639488 00000100:00100000:1.0:1789403139.491699:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639488 00000100:00100000:1.0:1789403139.491712:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639104 00000100:00100000:1.0:1789403139.491714:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639104 00000100:00100000:1.0:1789403139.491726:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403139.491846:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050638848:12345-0@lo:400: 00000100:00100000:1.0:1789403139.491897:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050638848:12345-0@lo:400: Request processed in 164us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.491904:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403139.491920:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403139.491925:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050639360:12345-0@lo:400: 00000100:00100000:1.0:1789403139.491950:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050639360:12345-0@lo:400: Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.491955:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403139.491965:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403139.491970:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050639488:12345-0@lo:400: 00000100:00100000:1.0:1789403139.491998:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050639488:12345-0@lo:400: Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.492003:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403139.492013:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403139.492019:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050639104:12345-0@lo:400: 00000100:00100000:1.0:1789403139.492042:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050639104:12345-0@lo:400: Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.492048:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403139.492067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639232 00000100:00100000:1.0:1789403139.492076:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639232 00000100:00100000:1.0:1789403139.492094:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638976 00000100:00100000:1.0:1789403139.492096:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638976 00000100:00100000:1.0:1789403139.492108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403139.492113:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050639232:12345-0@lo:400: 00000100:00100000:1.0:1789403139.492142:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050639232:12345-0@lo:400: Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.492148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403139.492170:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403139.492176:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050638976:12345-0@lo:400: 00000100:00100000:1.0:1789403139.492201:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050638976:12345-0@lo:400: Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.492207:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403139.492245:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050639232:0@lo:400: 00010000:00080000:1.0:1789403139.492257:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a743480 x1876325050638848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403139.492266:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050638848:0@lo:400: 00010000:00080000:1.0:1789403139.492274:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a740a80 x1876325050639360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403139.492282:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050639360:0@lo:400: 00010000:00080000:1.0:1789403139.492309:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a740e00 x1876325050639104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403139.492317:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050639104:0@lo:400: 00000100:00100000:1.0:1789403139.492326:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050638976:0@lo:400: 00010000:00080000:1.0:1789403139.492334:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281839500 x1876325050639488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403139.492346:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050639488:0@lo:400: 00000100:00100000:3.0:1789403139.494061:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8546:1876325050638720:0@lo:502: 00000100:00100000:3.0:1789403139.494145:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.494198:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.494371:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050638592:0@lo:8: 00000100:00100000:2.0:1789403139.494429:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789403139.494467:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403139.494472:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403139.494662:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638592 00000100:00100000:3.0:1789403139.494669:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638592 00000100:00100000:3.0:1789403139.494704:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403139.494710:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050638592:12345-0@lo:8: 00010000:00080000:3.0:1789403139.494737:0:8415:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1789403139.494766:0:8415:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7609c7 00002000:00100000:3.0:1789403139.494815:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90a141b01800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789403139.494821:0:8415:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1789403139.494824:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789403139.495471:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050638720 00000100:00100000:0.0:1789403139.495478:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050638720 00000100:00100000:0.0:1789403139.495641:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789403139.495649:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8546:x1876325050638720:12345-0@lo:502: 00000100:00100000:0.0:1789403139.496010:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:8546:x1876325050638720:12345-0@lo:502: Request processed in 360us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403139.496018:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00002000:00100000:3.0:1789403139.496422:0:8415:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789403139.497086:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789403139.497117:0:8415:0:(import.c:65:import_set_state_nolock()) ffff90a141b02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403139.497371:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050638592:12345-0@lo:8: Request processed in 2488us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403139.497380:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403139.497454:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8546:1876325050638720:0@lo:502: 00010000:00080000:2.0:1789403139.497527:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aaed80 x1876325050638592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:3.0:1789403139.497614:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403139.497673:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403139.497677:0:8546:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789403139.497685:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1789403139.497752:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403139.497761:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789403139.497770:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789403139.497776:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789403139.497816:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1421c7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789403139.497836:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789403139.497841:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050638592:0@lo:8: 00000020:01000000:3.0:1789403139.497862:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789403139.497884:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:2.0:1789403139.497898:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050639616:0@lo:700: 00000004:00080000:0.0:1789403139.497904:0:8549:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789403139.497949:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789403139.497968:0:8549:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 185496577940ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789403139.497971:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2c00 going to sleep for 11 seconds 00080000:00080000:0.0:1789403139.497976:0:8549:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:3.0:1789403139.498055:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.498067:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403139.498077:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789403139.498080:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a244ea0000 from 30 10000000:01000000:3.0:1789403139.498083:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403139.498106:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.498114:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.498123:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403139.498134:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050639744:0@lo:101: 00000100:00100000:3.0:1789403139.498176:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.498242:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.498263:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639616 00000100:00100000:3.0:1789403139.498268:0:8423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639616 00000100:00100000:3.0:1789403139.498308:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403139.498317:0:8423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8550:x1876325050639616:12345-0@lo:700: 00000100:00100000:3.0:1789403139.498347:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8423:1876325050639872:0@lo:700: 00000100:00100000:3.0:1789403139.498420:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.498438:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00e40 going to sleep for 11 seconds 00000100:00080000:3.0:1789403139.498449:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403139.498465:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639872 00000100:00100000:3.0:1789403139.498469:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639872 00000100:00100000:3.0:1789403139.498502:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403139.498510:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8423:x1876325050639872:12345-0@lo:700: 00000100:00100000:1.0:1789403139.498642:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050639744 00000100:00100000:1.0:1789403139.498646:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050639744 00000100:00100000:1.0:1789403139.498681:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789403139.498690:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050639744:12345-0@lo:101: 00010000:00010000:1.0:1789403139.498700:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403139.498713:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7609ce expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403139.498733:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403139.498743:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403139.498751:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a26400, rc 0) 00000100:00100000:1.0:1789403139.498857:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050639744:12345-0@lo:101: Request processed in 169us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.498863:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789403139.498984:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050639744:0@lo:101: 00010000:00010000:2.0:1789403139.499002:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.499013:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.499086:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640000:0@lo:501: 00000100:00100000:2.0:1789403139.499114:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.499147:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403139.499227:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640000 00000100:00100000:1.0:1789403139.499231:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640000 00000100:00100000:1.0:1789403139.499266:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789403139.499272:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050640000:12345-0@lo:501: 00000100:00100000:1.0:1789403139.499386:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050640000:12345-0@lo:501: Request processed in 113us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.499450:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789403139.499988:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640000:0@lo:501: 00000100:00100000:3.0:1789403139.500023:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640128:0@lo:503: 00000100:00100000:3.0:1789403139.500217:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.500259:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.503880:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640128 00000100:00100000:2.0:1789403139.503902:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640128 00000100:00100000:2.0:1789403139.503958:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789403139.504091:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050640128:12345-0@lo:503: 00000100:00100000:2.0:1789403139.505049:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050640128:12345-0@lo:503: Request processed in 1080us (4829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.505061:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:1.0:1789403139.506435:0:7431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789403139.506713:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640128:0@lo:503: 00000100:00100000:1.0:1789403139.507572:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8552:1876325050640256:0@lo:502: 00000100:00100000:1.0:1789403139.507644:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.507686:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2819dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.507882:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640256 00000100:00100000:3.0:1789403139.507890:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640256 00000100:00100000:3.0:1789403139.507943:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789403139.507954:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8552:x1876325050640256:12345-0@lo:502: 00000100:00100000:3.0:1789403139.508068:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8552:x1876325050640256:12345-0@lo:502: Request processed in 116us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403139.508076:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789403139.508186:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8552:1876325050640256:0@lo:502: 00000100:00100000:1.0:1789403139.508233:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8552:1876325050640384:0@lo:502: 00000100:00100000:1.0:1789403139.508268:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.508348:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a258b1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.508745:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640384 00000100:00100000:3.0:1789403139.508751:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640384 40000000:02000000:0.0:1789403139.508760:0:6506:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789403139.510186:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789403139.510323:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8552:x1876325050640384:12345-0@lo:502: 00000100:00100000:2.0:1789403139.512459:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:8552:x1876325050640384:12345-0@lo:502: Request processed in 2136us (4182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.512472:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789403139.512989:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8552:1876325050640384:0@lo:502: 00000040:00080000:3.0:1789403139.513200:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789403139.513284:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789403139.513308:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789403139.513319:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.513330:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403139.513341:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789403139.513344:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a244ea0000 from 5 10000000:01000000:2.0:1789403139.513347:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789403139.513381:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.513414:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.513435:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.513453:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640512:0@lo:101: 00000100:00100000:2.0:1789403139.513498:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.513531:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.513548:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640512 00000100:00100000:2.0:1789403139.513554:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640512 00000100:00100000:2.0:1789403139.513593:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789403139.513602:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050640512:12345-0@lo:101: 00010000:00010000:2.0:1789403139.513614:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403139.513627:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7609dc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.513651:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.513661:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 19 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.513669:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947e00, rc 0) 00000100:00100000:2.0:1789403139.513716:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050640512:12345-0@lo:101: Request processed in 115us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.513721:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789403139.513770:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640512:0@lo:101: 00010000:00010000:2.0:1789403139.514119:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.514141:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.514440:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640640:0@lo:256: 00000100:00100000:2.0:1789403139.514481:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.514521:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.514538:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640640 00000100:00100000:2.0:1789403139.514543:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640640 00000100:00100000:2.0:1789403139.515083:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789403139.515093:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050640640:12345-0@lo:256: 20000000:01000000:2.0:1789403139.515112:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789403139.515129:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789403139.515133:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789403139.515456:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050640640:12345-0@lo:256: Request processed in 364us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.515463:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789403139.515524:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640640:0@lo:256: 10000000:01000000:2.0:1789403139.515747:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789403139.515756:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.516031:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403139.516042:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789403139.516045:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789403139.516049:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789403139.516170:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.516178:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.516187:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.516216:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640768:0@lo:101: 00000100:00100000:2.0:1789403139.516310:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.516350:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.516479:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640768 00000100:00100000:3.0:1789403139.516487:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640768 00000100:00100000:3.0:1789403139.516526:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789403139.516534:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050640768:12345-0@lo:101: 00010000:00010000:3.0:1789403139.516544:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403139.516561:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7609ea expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.516583:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.516594:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.516603:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185200, rc 0) 00000100:00100000:3.0:1789403139.516641:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050640768:12345-0@lo:101: Request processed in 108us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403139.516647:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789403139.516683:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640768:0@lo:101: 00010000:00010000:3.0:1789403139.516696:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403139.516704:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403139.516767:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640896:0@lo:501: 00000100:00100000:3.0:1789403139.516800:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.516816:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00840 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.516829:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050640896 00000100:00100000:3.0:1789403139.516832:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050640896 00000100:00100000:3.0:1789403139.516865:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789403139.516871:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050640896:12345-0@lo:501: 00000100:00100000:3.0:1789403139.518041:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050640896:12345-0@lo:501: Request processed in 1164us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.518080:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050640896:0@lo:501: 00000100:00100000:2.0:1789403139.518122:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050641024:0@lo:503: 00000100:00100000:3.0:1789403139.518172:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789403139.518177:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.518204:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537780 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.518213:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641024 00000100:00100000:3.0:1789403139.518218:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641024 00000100:00100000:2.0:1789403139.518334:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789403139.518343:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050641024:12345-0@lo:503: 00000100:00100000:2.0:1789403139.518444:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050641024:12345-0@lo:503: Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.518451:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789403139.518493:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050641024:0@lo:503: 00000100:00100000:0.0:1789403139.521263:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8423:x1876325050639872:12345-0@lo:700: Request processed in 22745us (22865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403139.521282:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403139.521339:0:8423:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aaf100 x1876325050639872/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.521366:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8423:1876325050639872:0@lo:700: 40000000:02000000:0.0:1789403139.521386:0:8423:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1789403139.526764:0:8554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8554:1876325050641152:0@lo:502: 00000100:00100000:3.0:1789403139.526928:0:8554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.527000:0:8554:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403139.527050:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641152 00000100:00100000:1.0:1789403139.527059:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641152 00000100:00100000:1.0:1789403139.527110:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789403139.527120:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:8554:x1876325050641152:12345-0@lo:502: 00000100:00100000:1.0:1789403139.527269:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:8554:x1876325050641152:12345-0@lo:502: Request processed in 151us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.527276:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789403139.527423:0:8554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8554:1876325050641152:0@lo:502: 00000020:01000000:3.0:1789403139.527453:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789403139.527469:0:8554:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789403139.527476:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.527479:0:8554:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789403139.527487:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403139.527497:0:8554:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:3.0:1789403139.528121:0:8554:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789403139.528126:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403139.528150:0:8554:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a27dbd19c0) 00000020:00000080:3.0:1789403139.528185:0:8554:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789403139.528193:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403139.528296:0:8554:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789403139.528302:0:8554:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789403139.528309:0:8554:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7609ff 00010000:00080000:3.0:1789403139.528338:0:8554:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a27dbdf000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403139.529306:0:8554:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:1.0:1789403139.531353:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789403139.532633:0:8423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8550:x1876325050639616:12345-0@lo:700: Request processed in 34309us (34677us total) trans 0 rc 0/0 00010000:00080000:3.0:1789403139.532639:0:8550:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a246f3c380 x1876325050639616/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403139.532648:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403139.532653:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050639616:0@lo:700: 00000040:01000000:2.0:1789403139.542232:0:8554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789403139.542258:0:8554:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789403139.543924:0:8554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403139.544202:0:8554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403139.544313:0:8554:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789403139.553851:0:8554:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000004:00080000:1.0:1789403139.554790:0:8550:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789403139.554822:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050641408:0@lo:7: 00000100:00100000:1.0:1789403139.555463:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.555495:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.555674:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050641280:0@lo:13: 00000100:00100000:2.0:1789403139.555716:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.555766:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641408 00000100:00100000:2.0:1789403139.555773:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641408 00000100:00100000:2.0:1789403139.555812:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403139.555820:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8550:x1876325050641408:12345-0@lo:7: 00000100:00100000:1.0:1789403139.556515:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641280 00000100:00100000:1.0:1789403139.556528:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641280 00000100:00100000:1.0:1789403139.556839:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403139.556851:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050641280:12345-0@lo:13: 00002000:00000024:1.0:1789403139.556948:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1789403139.557015:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050641280:12345-0@lo:13: Request processed in 167us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.557022:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789403139.558510:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281839500 x1876325050641280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403139.558597:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050641280:0@lo:13: 00000040:00080000:3.0:1789403139.560759:0:8559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789403139.560766:0:8559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789403139.568933:0:8554:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789403139.568949:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789403139.568992:0:8554:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789403139.569017:0:8554:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b760a06 00000100:00080000:3.0:1789403139.569030:0:8554:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403139.569042:0:8554:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a27dbdf000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403139.569080:0:8554:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aac380 x1876325050641536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403139.569106:0:8554:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789403139.569170:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403139.569175:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.569176:0:8554:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789403139.569180:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403139.569184:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.569185:0:8554:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403139.569187:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403139.569189:0:8554:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789403139.569215:0:8554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8554:1876325050641664:0@lo:502: 00000100:00100000:3.0:1789403139.569292:0:8554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403139.569327:0:8554:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.569348:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641664 00000100:00100000:3.0:1789403139.569354:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641664 00000100:00100000:3.0:1789403139.569411:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789403139.569420:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:8554:x1876325050641664:12345-0@lo:502: 00000100:00100000:3.0:1789403139.569550:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:8554:x1876325050641664:12345-0@lo:502: Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403139.569557:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789403139.570419:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050641536:0@lo:8: 00000100:00100000:2.0:1789403139.570465:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.570552:0:8415:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789403139.570560:0:8415:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:2.0:1789403139.570729:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403139.572103:0:8554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:8554:1876325050641664:0@lo:502: 00000020:01000000:3.0:1789403139.572145:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403139.572153:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403139.572156:0:8554:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789403139.572170:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1789403139.572454:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641536 00000100:00100000:2.0:1789403139.572461:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641536 00000020:01000000:2.0:1789403139.572492:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789403139.572688:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789403139.572700:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.572712:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403139.572723:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789403139.572726:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a245c9b380 from 1 10000000:01000000:2.0:1789403139.572729:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789403139.572760:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.572768:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.572789:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.572808:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050641792:0@lo:101: 00000100:00100000:2.0:1789403139.572856:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.573010:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403139.574872:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641792 00000100:00100000:1.0:1789403139.574883:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641792 00000100:00100000:1.0:1789403139.574925:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789403139.574934:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050641792:12345-0@lo:101: 00010000:00010000:1.0:1789403139.574951:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403139.574968:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760a0d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403139.574995:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403139.575007:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403139.575016:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27e00, rc 0) 00000100:00100000:1.0:1789403139.575078:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050641792:12345-0@lo:101: Request processed in 146us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.575085:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403139.575355:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050641792:0@lo:101: 00010000:00010000:2.0:1789403139.575372:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.575381:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403139.575470:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050641920:0@lo:501: 00000100:00100000:2.0:1789403139.575627:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403139.575657:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403139.575959:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050641920 00000100:00100000:1.0:1789403139.575965:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050641920 00000100:00100000:1.0:1789403139.575992:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789403139.575999:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050641920:12345-0@lo:501: 00000100:00100000:1.0:1789403139.576080:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050641920:12345-0@lo:501: Request processed in 81us (579us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403139.576086:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789403139.576468:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050641920:0@lo:501: 10000000:01000000:2.0:1789403139.576499:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789403139.576719:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403139.576729:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403139.578699:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403139.578710:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3625:x1876325050641536:12345-0@lo:8: 00010000:00080000:1.0:1789403139.578739:0:8563:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1789403139.578765:0:8563:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b760a1b 00002000:00100000:1.0:1789403139.578789:0:8563:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a14216c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789403139.578793:0:8563:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789403139.578796:0:8563:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789403139.578851:0:8563:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789403139.580742:0:8563:0:(import.c:65:import_set_state_nolock()) ffff90a14216e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403139.580839:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050641536:12345-0@lo:8: Request processed in 2126us (10369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.580850:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789403139.582496:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aac380 x1876325050641536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403139.583723:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403139.583735:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789403139.583746:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789403139.583753:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789403139.583756:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789403139.583778:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789403139.583786:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050641536:0@lo:8: 00000004:00080000:0.0:1789403139.584429:0:8559:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789403139.586112:0:8559:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 185584720392ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789403139.586124:0:8559:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:2.0:1789403139.587230:0:8417:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789403139.587240:0:8417:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789403139.587353:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8550:x1876325050641408:12345-0@lo:7: Request processed in 31520us (31879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.587364:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403139.588648:0:8550:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a742680 x1876325050641408/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.588667:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050641408:0@lo:7: 00000004:00080000:0.0:1789403139.588681:0:8550:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789403139.588717:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050642048:0@lo:5: 00000100:00100000:0.0:1789403139.588763:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.588793:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2607973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.589719:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642048 00000100:00100000:2.0:1789403139.589729:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642048 00000100:00100000:2.0:1789403139.589780:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403139.589789:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8550:x1876325050642048:12345-0@lo:5: 00002000:00080000:2.0:1789403139.589815:0:8415:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789403139.589865:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8550:x1876325050642048:12345-0@lo:5: Request processed in 77us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.589877:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789403139.590469:0:8550:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281912300 x1876325050642048/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.590483:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050642048:0@lo:5: 00000004:00080000:0.0:1789403139.590495:0:8550:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789403139.590541:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050642176:0@lo:5: 00000100:00100000:0.0:1789403139.590583:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.590604:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2607973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403139.591096:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642176 00000100:00100000:1.0:1789403139.591104:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642176 00000100:00100000:1.0:1789403139.591144:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403139.591153:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8550:x1876325050642176:12345-0@lo:5: 00002000:00080000:1.0:1789403139.591195:0:8563:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000004:00080000:0.0:1789403139.592808:0:8561:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789403139.592840:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642432:0@lo:7: 00000100:00100000:1.0:1789403139.593676:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050642304:0@lo:13: 00000100:00100000:1.0:1789403139.593741:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.594123:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.594128:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642304 00000100:00100000:1.0:1789403139.594136:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642304 00000100:00100000:0.0:1789403139.594151:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403139.594213:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403139.594222:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050642304:12345-0@lo:13: 00002000:00000024:1.0:1789403139.594267:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923808256 avail 3692285952 00000100:00100000:1.0:1789403139.594323:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050642304:12345-0@lo:13: Request processed in 102us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.594331:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403139.594629:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642432 00000100:00100000:2.0:1789403139.594635:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642432 00000100:00100000:2.0:1789403139.594663:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403139.594671:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8561:x1876325050642432:12345-0@lo:7: 00010000:00080000:0.0:1789403139.595657:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281912680 x1876325050642304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.595681:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050642304:0@lo:13: 00000100:00080000:3.0:1789403139.595812:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403139.600626:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8550:x1876325050642176:12345-0@lo:5: Request processed in 9468us (10035us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789403139.600645:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789403139.600706:0:8550:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281912300 x1876325050642176/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.600724:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8550:1876325050642176:0@lo:5: 00000004:00080000:0.0:1789403139.600741:0:8550:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789403139.600782:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8550:1876325050642560:0@lo:900: 00000100:00100000:0.0:1789403139.600824:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.600849:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2607973c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403139.600878:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642560 00000100:00100000:0.0:1789403139.600885:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642560 00000100:00100000:0.0:1789403139.600949:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403139.600959:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8550:x1876325050642560:12345-0@lo:900: 00000100:00100000:0.0:1789403139.602599:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8550:x1876325050642560:12345-0@lo:900: Request processed in 1637us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403139.602612:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403139.602666:0:8550:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281912680 x1876325050642560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.602679:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8550:1876325050642560:0@lo:900: 00000004:00080000:2.0:1789403139.604525:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789403139.608897:0:8415:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789403139.608906:0:8415:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789403139.609120:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8561:x1876325050642432:12345-0@lo:7: Request processed in 14445us (14994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403139.609131:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789403139.609266:0:8561:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050642432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.609283:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642432:0@lo:7: 00000004:00080000:0.0:1789403139.609297:0:8561:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789403139.609333:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642688:0@lo:5: 00000100:00100000:0.0:1789403139.609377:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.609431:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.609442:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642688 00000100:00100000:2.0:1789403139.609450:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642688 00000100:00100000:2.0:1789403139.609499:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403139.609509:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8561:x1876325050642688:12345-0@lo:5: 00002000:00080000:2.0:1789403139.609535:0:8417:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789403139.609539:0:8417:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789403139.618340:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1789403139.619294:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789403139.619303:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789403139.619621:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8561:x1876325050642688:12345-0@lo:5: Request processed in 10109us (10238us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789403139.619633:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789403139.619692:0:8561:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050642688/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.619704:0:8561:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789403139.619710:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642688:0@lo:5: 00000004:00080000:0.0:1789403139.619725:0:8561:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789403139.619770:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642816:0@lo:700: 00000100:00100000:0.0:1789403139.619801:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403139.619874:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a260797600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403139.627716:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642816 00000100:00100000:2.0:1789403139.627729:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642816 00000100:00100000:2.0:1789403139.627782:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403139.627791:0:8423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8561:x1876325050642816:12345-0@lo:700: 00000100:00100000:2.0:1789403139.643297:0:8423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8561:x1876325050642816:12345-0@lo:700: Request processed in 15496us (23484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403139.643311:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403139.643433:0:8561:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050642816/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403139.643451:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642816:0@lo:700: 00000004:02000040:1.0:1789403139.647372:0:8561:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789403139.655501:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642944:0@lo:5: 00000100:00100000:1.0:1789403139.655585:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403139.655648:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2599880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403139.655683:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050642944 00000100:00100000:3.0:1789403139.655693:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050642944 00000100:00100000:3.0:1789403139.655751:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403139.655761:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8561:x1876325050642944:12345-0@lo:5: 00002000:00080000:3.0:1789403139.665300:0:8563:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789403139.665319:0:8563:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789403139.672798:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8561:x1876325050642944:12345-0@lo:5: Request processed in 17032us (17207us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789403139.672811:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789403139.673066:0:8561:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a743480 x1876325050642944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403155 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403139.673084:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8561:1876325050642944:0@lo:5: 00000004:00080000:3.0:1789403139.673100:0:8561:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1789403140.337775:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050643072:0@lo:41: 00000100:00100000:1.0:1789403140.337851:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403140.338201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643072 00000100:00100000:2.0:1789403140.338210:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643072 00000100:00100000:2.0:1789403140.338259:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403140.338281:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050643072:12345-0@lo:41: 00000004:00000024:2.0:1789403140.338316:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789403140.342424:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050643072:12345-0@lo:41: Request processed in 4146us (4562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403140.342438:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403140.343477:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050643072:0@lo:41: 00010000:00010000:1.0:1789403140.595800:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403141.366062:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403141.366086:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050643200:0@lo:41: 00000100:00100000:1.0:1789403141.366181:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403141.366218:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643200 00000100:00100000:2.0:1789403141.366226:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643200 00000100:00100000:2.0:1789403141.366277:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403141.366286:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050643200:12345-0@lo:41: 00000004:00000024:2.0:1789403141.366315:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789403141.366361:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050643200:12345-0@lo:41: Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403141.366374:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403141.366385:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050643200:0@lo:41: 00010000:00010000:0.0:1789403141.618764:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403142.644372:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403143.666626:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789403143.812446:0:8792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789403144.692683:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403144.700963:0:8845:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403144.701222:0:8845:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789403144.945986:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050643328:0@lo:400: 00000100:00100000:3.0:1789403144.946066:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403144.946112:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050643840:0@lo:400: 00000100:00100000:3.0:1789403144.946162:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403144.946187:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050644352:0@lo:400: 00000100:00100000:3.0:1789403144.946210:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403144.946252:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789403144.946259:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050643712:0@lo:400: 00000100:00100000:0.0:1789403144.946280:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643840 00000100:00100000:3.0:1789403144.946286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403144.946290:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643840 00000100:00100000:3.0:1789403144.946314:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050644224:0@lo:400: 00000100:00100000:0.0:1789403144.946345:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403144.946351:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403144.946361:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050643840:12345-0@lo:400: 00000100:00100000:3.0:1789403144.946412:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050643456:0@lo:400: 00000100:00100000:3.0:1789403144.946444:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403144.946455:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050643840:12345-0@lo:400: Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403144.946463:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050643968:0@lo:400: 00000100:00100000:0.0:1789403144.946467:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403144.946490:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403144.946507:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050644480:0@lo:13: 00000100:00100000:0.0:1789403144.946510:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644352 00000100:00100000:0.0:1789403144.946515:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644352 00000100:00100000:3.0:1789403144.946532:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403144.946556:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789403144.946557:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644224 00000100:00100000:0.0:1789403144.946562:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644224 00000100:00100000:3.0:1789403144.946564:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050643584:0@lo:400: 00000100:00100000:3.0:1789403144.946587:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403144.946606:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050644096:0@lo:400: 00000100:00100000:0.0:1789403144.946610:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403144.946620:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050644352:12345-0@lo:400: 00000100:00100000:3.0:1789403144.946651:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403144.946673:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050644352:12345-0@lo:400: Request processed in 54us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403144.946681:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403144.946698:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403144.946707:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050644224:12345-0@lo:400: 00000100:00100000:3.0:1789403144.946709:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403144.946718:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050644608:0@lo:13: 00000100:00100000:0.0:1789403144.946748:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050644224:12345-0@lo:400: Request processed in 41us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403144.946752:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403144.946761:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789403144.946783:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403144.946801:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644480 00000100:00100000:0.0:1789403144.946806:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644480 00000100:00100000:0.0:1789403144.946823:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644608 00000100:00100000:0.0:1789403144.946827:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644608 00000100:00100000:0.0:1789403144.946842:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403144.946863:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050644480:12345-0@lo:13: 00002000:00000024:0.0:1789403144.946883:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403144.946941:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050644480:12345-0@lo:13: Request processed in 80us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403144.946948:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403144.946963:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403144.946970:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050644608:12345-0@lo:13: 00002000:00000024:0.0:1789403144.946981:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403144.947023:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050644608:12345-0@lo:13: Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403144.947029:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403144.947057:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643584 00000100:00100000:0.0:1789403144.947060:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643584 00000100:00100000:0.0:1789403144.947088:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789403144.947095:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050643584:12345-0@lo:400: 00000100:00100000:0.0:1789403144.947149:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050643584:12345-0@lo:400: Request processed in 54us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403144.947155:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789403144.947530:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aaf100 x1876325050644224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403144.947542:0:3629:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789403144.947560:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050644224:0@lo:400: 00000100:00100000:0.0:1789403144.947707:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050643840:0@lo:400: 00010000:00080000:0.0:1789403144.947719:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aaed80 x1876325050644352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403144.947728:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050644352:0@lo:400: 00010000:00080000:3.0:1789403144.948197:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f2f480 x1876325050644608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403144.948215:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643328 00000100:00100000:1.0:1789403144.948222:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643328 00000100:00100000:1.0:1789403144.948260:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789403144.948267:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3629:x1876325050643328:12345-0@lo:400: 00000100:00100000:1.0:1789403144.948332:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643712 00000100:00100000:1.0:1789403144.948336:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643712 00000100:00100000:1.0:1789403144.948359:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643456 00000100:00100000:1.0:1789403144.948362:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643456 00000100:00100000:1.0:1789403144.948374:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050643968 00000100:00100000:1.0:1789403144.948377:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050643968 00000100:00080000:2.0:1789403144.948444:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403144.948495:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644096 00000100:00100000:1.0:1789403144.948500:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644096 00000100:00100000:1.0:1789403144.948530:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403144.948620:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050643712:12345-0@lo:400: 00000100:00100000:1.0:1789403144.948677:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050643712:12345-0@lo:400: Request processed in 140us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403144.948685:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403144.948702:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403144.948709:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050643456:12345-0@lo:400: 00000100:00100000:1.0:1789403144.948740:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050643456:12345-0@lo:400: Request processed in 32us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403144.948745:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403144.948756:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789403144.948762:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050643968:12345-0@lo:400: 00000100:00100000:1.0:1789403144.948787:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050643968:12345-0@lo:400: Request processed in 26us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403144.948792:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789403144.948802:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789403144.948808:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050644096:12345-0@lo:400: 00000100:00100000:1.0:1789403144.948829:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050644096:12345-0@lo:400: Request processed in 22us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403144.948844:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789403144.948950:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3629:x1876325050643328:12345-0@lo:400: Request processed in 683us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403144.948958:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789403144.949024:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050644608:0@lo:13: 00000100:00100000:3.0:1789403144.949050:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050643584:0@lo:400: 00010000:00080000:3.0:1789403144.949061:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aac380 x1876325050644096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403144.949070:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050644096:0@lo:400: 00010000:00080000:3.0:1789403144.949079:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aaf480 x1876325050643456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403144.949088:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050643456:0@lo:400: 00010000:00080000:3.0:1789403144.949097:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aad180 x1876325050643968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403144.949104:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050643968:0@lo:400: 00010000:00080000:3.0:1789403144.949115:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050644480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403144.949603:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050644480:0@lo:13: 00000001:00080000:1.0:1789403144.949873:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00080000:2.0:1789403144.950884:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789403144.953111:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aad500 x1876325050643712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403144.953141:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050643712:0@lo:400: 00000100:00100000:1.0:1789403144.953155:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050643328:0@lo:400: 00000100:00100000:1.0:1789403145.457755:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403145.457777:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050644736:0@lo:41: 00000100:00100000:1.0:1789403145.457839:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403145.458088:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644736 00000100:00100000:1.0:1789403145.458095:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644736 00000100:00100000:1.0:1789403145.458154:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789403145.458163:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050644736:12345-0@lo:41: 00000004:00000024:1.0:1789403145.458311:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789403145.458366:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050644736:12345-0@lo:41: Request processed in 204us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403145.458374:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403145.458470:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050644736:0@lo:41: 00010000:00010000:0.0:1789403145.713976:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403146.481699:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403146.481726:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050644864:0@lo:41: 00000100:00100000:0.0:1789403146.481798:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403146.488930:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644864 00000100:00100000:3.0:1789403146.488946:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644864 00000100:00100000:3.0:1789403146.489014:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403146.489024:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050644864:12345-0@lo:41: 00000004:00000024:3.0:1789403146.489060:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789403146.489156:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050644864:12345-0@lo:41: Request processed in 133us (7357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403146.489162:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789403146.490016:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050644864:0@lo:41: 00010000:00010000:0.0:1789403146.739060:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403147.486844:0:8946:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403147.487157:0:8946:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403147.762569:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403148.437629:0:8994:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403148.437639:0:8994:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789403148.791016:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403149.809748:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403150.065865:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050645248:0@lo:400: 00000100:00100000:1.0:1789403150.065899:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050645120:0@lo:400: 00000100:00100000:2.0:1789403150.065948:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403150.065950:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403150.066020:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050644992:0@lo:400: 00000100:00100000:0.0:1789403150.067895:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645120 00000100:00100000:0.0:1789403150.067908:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645120 00000100:00100000:0.0:1789403150.067973:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403150.067983:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050645120:12345-0@lo:400: 00000100:00100000:1.0:1789403150.068162:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050645632:0@lo:400: 00000100:00100000:3.0:1789403150.068163:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403150.068179:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050645120:12345-0@lo:400: Request processed in 197us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403150.068188:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403150.068203:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050645504:0@lo:400: 00000100:00100000:1.0:1789403150.068205:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403150.068635:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050645760:0@lo:400: 00000100:00100000:0.0:1789403150.069566:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050644992 00000100:00100000:0.0:1789403150.069582:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050644992 00000100:00100000:0.0:1789403150.069624:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789403150.069633:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3626:x1876325050644992:12345-0@lo:400: 00000100:00100000:3.0:1789403150.070721:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403150.070765:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050646016:0@lo:400: 00000100:00100000:3.0:1789403150.070797:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403150.072162:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050646144:0@lo:13: 00000100:00100000:1.0:1789403150.072216:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789403150.072269:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a64b480 x1876325050645120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403150.072284:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050645120:0@lo:400: 00000100:00100000:1.0:1789403150.072323:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645632 00000100:00100000:0.0:1789403150.072330:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3626:x1876325050644992:12345-0@lo:400: Request processed in 2695us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403150.072331:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645632 00000100:00100000:0.0:1789403150.072353:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789403150.072384:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789403150.072411:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050645632:12345-0@lo:400: 00000100:00100000:2.0:1789403150.072432:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403150.072471:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050646272:0@lo:13: 00000100:00100000:2.0:1789403150.072498:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403150.072518:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789403150.072524:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050645376:0@lo:400: 00000100:00100000:2.0:1789403150.072545:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403150.072557:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050645888:0@lo:400: 00000100:00100000:2.0:1789403150.072587:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645248 00000100:00100000:2.0:1789403150.072592:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645248 00000100:00100000:2.0:1789403150.072613:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645504 00000100:00100000:2.0:1789403150.072616:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645504 00000100:00100000:2.0:1789403150.072629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403150.072636:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050645248:12345-0@lo:400: 00000100:00100000:2.0:1789403150.072674:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050645248:12345-0@lo:400: Request processed in 37us (6730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403150.072680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789403150.072696:0:6499:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403150.072703:0:6499:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789403150.072707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403150.072712:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050645504:12345-0@lo:400: 00000100:00100000:2.0:1789403150.072742:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050645504:12345-0@lo:400: Request processed in 29us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403150.072747:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789403150.072763:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403150.072797:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646144 00000100:00100000:2.0:1789403150.072800:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646144 00000100:00100000:2.0:1789403150.072820:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646272 00000100:00100000:2.0:1789403150.072822:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646272 00000100:00100000:0.0:1789403150.072830:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645760 00000100:00100000:0.0:1789403150.072834:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645760 00000100:00100000:0.0:1789403150.072852:0:6499:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403150.072858:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645376 00000100:00100000:0.0:1789403150.072860:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645376 00000100:00100000:0.0:1789403150.072871:0:6499:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403150.072877:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403150.072882:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050645760:12345-0@lo:400: 00000100:00100000:0.0:1789403150.072918:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050645760:12345-0@lo:400: Request processed in 35us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403150.072924:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403150.072935:0:6499:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403150.072947:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403150.072953:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050645376:12345-0@lo:400: 00000100:00100000:2.0:1789403150.072958:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403150.072963:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050646144:12345-0@lo:13: 00000100:00100000:0.0:1789403150.072980:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050645376:12345-0@lo:400: Request processed in 28us (434us total) trans 0 rc 0/0 00002000:00000024:2.0:1789403150.072985:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403150.072986:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789403150.073017:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050646144:12345-0@lo:13: Request processed in 53us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403150.073022:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403150.073034:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403150.073039:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050646272:12345-0@lo:13: 00002000:00000024:2.0:1789403150.073048:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403150.073154:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050646272:12345-0@lo:13: Request processed in 114us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403150.073160:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789403150.073180:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403150.073183:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403150.073229:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646016 00000100:00100000:2.0:1789403150.073233:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646016 00000100:00100000:2.0:1789403150.073261:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403150.073267:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050646016:12345-0@lo:400: 00000100:00100000:2.0:1789403150.073737:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050646016:12345-0@lo:400: Request processed in 469us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403150.073740:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050644992:0@lo:400: 00000100:00100000:2.0:1789403150.073751:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403150.073760:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050645504:0@lo:400: 00010000:00080000:3.0:1789403150.073774:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a648000 x1876325050646016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403150.073784:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403150.073790:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789403150.073809:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050646016:0@lo:400: 00000100:00100000:0.0:1789403150.073987:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050645888 00000100:00100000:0.0:1789403150.073993:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050645888 00000100:00100000:0.0:1789403150.074029:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403150.074038:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050645888:12345-0@lo:400: 00000100:00100000:1.0:1789403150.074049:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050645632:12345-0@lo:400: Request processed in 1638us (5844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403150.074058:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789403150.074090:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050645888:12345-0@lo:400: Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403150.074096:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789403150.074292:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910700 x1876325050646272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403150.074312:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050646272:0@lo:13: 00000100:00100000:2.0:1789403150.074331:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050645248:0@lo:400: 00010000:00080000:2.0:1789403150.074347:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a64a680 x1876325050645760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403150.074356:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050645760:0@lo:400: 00010000:00080000:2.0:1789403150.074409:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a648380 x1876325050645376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403150.074526:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050645376:0@lo:400: 00010000:00080000:2.0:1789403150.074542:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a648a80 x1876325050645888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403150.074551:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050645888:0@lo:400: 00010000:00080000:1.0:1789403150.074721:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a648e00 x1876325050645632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403150.074732:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050645632:0@lo:400: 00010000:00080000:1.0:1789403150.074744:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251f480 x1876325050646144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403150.074756:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050646144:0@lo:13: 00000100:00100000:0.0:1789403150.577790:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403150.577817:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050646400:0@lo:41: 00000100:00100000:0.0:1789403150.577895:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403150.577999:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646400 00000100:00100000:1.0:1789403150.578007:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646400 00000100:00100000:1.0:1789403150.578060:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403150.578069:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050646400:12345-0@lo:41: 00000004:00000024:1.0:1789403150.578111:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789403150.578158:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050646400:12345-0@lo:41: Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403150.578175:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403150.578310:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050646400:0@lo:41: 00010000:00010000:1.0:1789403150.834427:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403151.604839:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403151.604863:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050646528:0@lo:41: 00000100:00100000:1.0:1789403151.604930:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403151.605006:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646528 00000100:00100000:1.0:1789403151.605014:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646528 00000100:00100000:1.0:1789403151.605058:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789403151.605076:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050646528:12345-0@lo:41: 00000004:00000024:1.0:1789403151.605110:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789403151.605155:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050646528:12345-0@lo:41: Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403151.605163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789403151.605217:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050646528:0@lo:41: 00010000:00010000:3.0:1789403151.858650:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403152.885719:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403153.911265:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403154.930853:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403155.185578:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403155.185604:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050646656:0@lo:13: 00000100:00100000:0.0:1789403155.185675:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403155.186021:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050647040:0@lo:400: 00000100:00100000:0.0:1789403155.186062:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403155.186086:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050647552:0@lo:400: 00000100:00100000:0.0:1789403155.186117:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403155.186136:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789403155.186142:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050647168:0@lo:400: 00000100:00100000:0.0:1789403155.186162:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403155.186194:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050647680:0@lo:400: 00000100:00100000:0.0:1789403155.186217:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403155.186324:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050646784:0@lo:400: 00000100:00100000:2.0:1789403155.186361:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403155.186407:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050647296:0@lo:400: 00000100:00100000:2.0:1789403155.186429:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403155.186446:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050647808:0@lo:13: 00000100:00100000:2.0:1789403155.186465:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403155.186493:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789403155.186499:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050646912:0@lo:400: 00000100:00100000:2.0:1789403155.186522:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403155.186539:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050647424:0@lo:400: 00000100:00100000:2.0:1789403155.186561:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403155.186634:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646656 00000100:00100000:3.0:1789403155.186642:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646656 00000100:00100000:3.0:1789403155.186685:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647808 00000100:00100000:3.0:1789403155.186689:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647808 00000100:00100000:3.0:1789403155.186708:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403155.186717:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050646656:12345-0@lo:13: 00002000:00000024:3.0:1789403155.186742:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403155.186783:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050646656:12345-0@lo:13: Request processed in 68us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.186790:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403155.186805:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403155.186811:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050647808:12345-0@lo:13: 00002000:00000024:3.0:1789403155.186830:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403155.186861:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050647808:12345-0@lo:13: Request processed in 51us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.186868:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403155.186907:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647552 00000100:00100000:3.0:1789403155.186911:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647552 00000100:00100000:3.0:1789403155.186932:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647168 00000100:00100000:3.0:1789403155.186935:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647168 00000100:00100000:3.0:1789403155.186945:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646912 00000100:00100000:3.0:1789403155.186948:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646912 00000100:00100000:3.0:1789403155.186957:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647424 00000100:00100000:3.0:1789403155.186960:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647424 00000100:00100000:3.0:1789403155.186974:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403155.186981:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050647552:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187014:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050647552:12345-0@lo:400: Request processed in 34us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187021:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403155.187032:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789403155.187049:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050647168:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187077:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050647168:12345-0@lo:400: Request processed in 40us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187083:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789403155.187094:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403155.187099:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050646912:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187126:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050646912:12345-0@lo:400: Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187131:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403155.187151:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403155.187157:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050647424:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187184:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050647424:12345-0@lo:400: Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187189:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403155.187208:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647040 00000100:00100000:3.0:1789403155.187211:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647040 00000100:00100000:3.0:1789403155.187239:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647296 00000100:00100000:3.0:1789403155.187242:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647296 00000100:00100000:3.0:1789403155.187253:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403155.187258:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050647040:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187287:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050647040:12345-0@lo:400: Request processed in 29us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187293:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403155.187303:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403155.187308:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050647296:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187330:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050647296:12345-0@lo:400: Request processed in 22us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187336:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403155.187352:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050646784 00000100:00100000:3.0:1789403155.187355:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050646784 00000100:00100000:3.0:1789403155.187381:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789403155.187408:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3628:x1876325050646784:12345-0@lo:400: 00000100:00100000:3.0:1789403155.187454:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3628:x1876325050646784:12345-0@lo:400: Request processed in 67us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403155.187460:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1789403155.187491:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403155.187500:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403155.187502:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403155.187535:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251ca80 x1876325050646912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403155.187549:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050646912:0@lo:400: 00010000:00080000:3.0:1789403155.187560:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251c700 x1876325050647424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403155.187568:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050647424:0@lo:400: 00000100:00100000:3.0:1789403155.187575:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050646784:0@lo:400: 00000100:00100000:3.0:1789403155.187583:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050647296:0@lo:400: 00010000:00080000:3.0:1789403155.187590:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050647808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403155.187602:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050647808:0@lo:13: 00000100:00100000:0.0:1789403155.187702:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050647040:0@lo:400: 00010000:00080000:0.0:1789403155.187712:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251f100 x1876325050647552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403155.187719:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050647552:0@lo:400: 00010000:00080000:0.0:1789403155.187728:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251f480 x1876325050646656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403155.187739:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050646656:0@lo:13: 00010000:00080000:0.0:1789403155.187756:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251e300 x1876325050647168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403155.187764:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050647168:0@lo:400: 00000100:00100000:2.0:1789403155.187848:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647680 00000100:00100000:2.0:1789403155.187852:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647680 00000100:00100000:2.0:1789403155.187877:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403155.187883:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050647680:12345-0@lo:400: 00000100:00100000:2.0:1789403155.187923:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050647680:12345-0@lo:400: Request processed in 40us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403155.187929:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789403155.188154:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14251dc00 x1876325050647680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403155.188163:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050647680:0@lo:400: 00000100:00100000:3.0:1789403155.697702:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403155.697729:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050647936:0@lo:41: 00000100:00100000:3.0:1789403155.697809:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403155.697956:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050647936 00000100:00100000:0.0:1789403155.697964:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050647936 00000100:00100000:0.0:1789403155.698020:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789403155.698030:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050647936:12345-0@lo:41: 00000004:00000024:0.0:1789403155.698074:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789403155.698125:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050647936:12345-0@lo:41: Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403155.698132:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789403155.698178:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050647936:0@lo:41: 00010000:00010000:3.0:1789403155.953630:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403156.723640:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050648064:0@lo:41: 00000100:00100000:0.0:1789403156.723711:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403156.723781:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648064 00000100:00100000:0.0:1789403156.723800:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648064 00000100:00100000:0.0:1789403156.723846:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403156.723856:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050648064:12345-0@lo:41: 00000004:00000024:0.0:1789403156.723886:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789403156.723930:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050648064:12345-0@lo:41: Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403156.723936:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403156.723982:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050648064:0@lo:41: 00010000:00010000:0.0:1789403156.978590:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789403157.304974:0:9493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789403157.304977:0:9493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789403157.304979:0:9493:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789403157.305123:0:9493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a1424b5800 00000020:01000004:0.0:1789403157.305135:0:9493:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789403157.305148:0:9493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789403157.305168:0:9493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a1426499c0) 00000020:00000080:0.0:1789403157.305185:0:9493:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403157.359927:0:9493:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789403157.359996:0:9493:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789403157.408200:0:9493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789403157.410151:0:9493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789403157.410166:0:9493:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789403157.410177:0:9493:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5fb08b1e5b760a29 00000020:01000004:3.0:1789403157.410185:0:9493:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789403157.411379:0:9493:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789403157.411513:0:9493:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789403157.411524:0:9493:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789403157.411566:0:9493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789403157.411571:0:9493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789403157.445798:0:9493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789403157.445837:0:9493:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789403157.445842:0:9493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789403157.445844:0:9493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403157.445845:0:9493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403157.445847:0:9493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403157.445848:0:9493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403157.445850:0:9493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403157.445851:0:9493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403157.445852:0:9493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789403157.445854:0:9493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789403157.445855:0:9493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403157.445857:0:9493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403157.445860:0:9493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789403157.445863:0:9493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789403157.445864:0:9493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403157.445865:0:9493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403157.445867:0:9493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403157.445867:0:9493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403157.445869:0:9493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403157.445870:0:9493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403157.445871:0:9493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789403157.445872:0:9493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789403157.445873:0:9493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403157.445874:0:9493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403157.445909:0:9493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789403157.445927:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050648192:0@lo:253: 00000100:00100000:3.0:1789403157.445993:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.446053:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403157.447656:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648192 00000100:00100000:1.0:1789403157.447667:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648192 00000100:00100000:1.0:1789403157.447930:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789403157.447942:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:9493:x1876325050648192:12345-0@lo:253: 20000000:01000000:1.0:1789403157.447978:0:6493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789403157.447982:0:6493:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789403157.447987:0:6493:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789403157.447991:0:6493:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789403157.448288:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403157.448446:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789403157.448461:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789403157.448479:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789403157.448486:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789403157.448506:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789403157.448777:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789403157.448867:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789403157.448882:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:1.0:1789403157.448885:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789403157.448899:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789403157.448904:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789403157.448918:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789403157.448924:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:1.0:1789403157.448937:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789403157.448945:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789403157.448956:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789403157.448971:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789403157.449054:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789403157.449065:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:1.0:1789403157.449067:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789403157.449080:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789403157.449085:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789403157.449098:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789403157.449103:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:1.0:1789403157.449115:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789403157.449120:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789403157.449131:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789403157.449147:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789403157.451006:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789403157.451044:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.143@tcp 20000000:01000000:1.0:1789403157.451047:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789403157.451063:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789403157.451069:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789403157.451084:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789403157.451089:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.143@tcp (null) (null) 00000040:00080000:1.0:1789403157.451119:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789403157.451126:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789403157.451137:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789403157.451154:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789403157.451168:0:6493:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789403157.451170:0:6493:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789403157.451173:0:6493:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789403157.451215:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789403157.451218:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789403157.453491:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789403157.453538:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789403157.453570:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789403157.456222:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789403157.456259:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789403157.456276:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789403157.456291:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789403157.456294:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789403157.458575:0:9500:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789403157.458631:0:9500:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789403157.458729:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789403157.459139:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789403157.459165:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789403157.459195:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1789403157.459208:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789403157.459211:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789403157.459838:0:9501:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789403157.459861:0:9501:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789403157.459878:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789403157.460015:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789403157.460049:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789403157.460067:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789403157.460077:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789403157.460080:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789403157.460547:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789403157.460862:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789403157.460882:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789403157.460898:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1789403157.460907:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789403157.460909:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789403157.461739:0:9503:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789403157.461764:0:9503:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789403157.461777:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789403157.461936:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789403157.461959:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789403157.461973:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:0.0:1789403157.461987:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789403157.462006:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462041:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462049:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462056:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462063:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462069:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462076:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462083:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462089:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462125:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462142:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 21 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.462166:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648320:0@lo:104: 00000100:00100000:0.0:1789403157.462229:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403157.462285:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.462293:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 21 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.462301:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648448:0@lo:104: 00000100:00100000:0.0:1789403157.462321:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403157.462378:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.462379:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648320 00010000:00010000:0.0:1789403157.462413:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 21 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.462417:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648320 00000100:00100000:0.0:1789403157.462425:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648576:0@lo:104: 00000100:00100000:3.0:1789403157.462456:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648448 00000100:00100000:3.0:1789403157.462461:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648448 00000100:00100000:0.0:1789403157.462465:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.462481:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648576 00000100:00100000:3.0:1789403157.462485:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648576 00010000:00010000:0.0:1789403157.462500:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.462508:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789403157.462513:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 21 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.462520:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6493:x1876325050648320:12345-0@lo:104: 00010000:00010000:3.0:1789403157.462533:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.462580:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789403157.462586:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:6493:x1876325050648320:12345-0@lo:104: Request processed in 70us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.462593:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403157.462613:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789403157.462616:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789403157.462622:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6493:x1876325050648448:12345-0@lo:104: 00010000:00010000:1.0:1789403157.462625:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.462631:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.462635:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403157.462640:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.462653:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403157.462663:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403157.462669:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789403157.462711:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648704:0@lo:104: 00010000:00010000:1.0:1789403157.462744:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.462761:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403157.463509:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789403157.463522:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6493:x1876325050648448:12345-0@lo:104: Request processed in 899us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.463532:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403157.463558:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403157.463567:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6493:x1876325050648576:12345-0@lo:104: 00010000:00010000:3.0:1789403157.463577:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.463691:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789403157.463697:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6493:x1876325050648576:12345-0@lo:104: Request processed in 133us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.463704:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789403157.463723:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403157.463728:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.463789:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403157.463793:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.463803:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403157.463810:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403157.463816:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403157.463836:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.463842:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403157.463860:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.463925:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947400/0x5fb08b1e5b7609ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.463950:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403157.464065:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464073:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403157.464077:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464084:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403157.464091:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403157.464097:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403157.464111:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464117:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403157.464122:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464129:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b7609ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609d5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464138:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.464140:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.464142:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403157.464155:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050649088:0@lo:103: 00000100:00100000:3.0:1789403157.464189:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.464474:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403157.464481:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050648960:0@lo:103: 00000100:00100000:3.0:1789403157.464505:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.464533:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649088 00000100:00100000:3.0:1789403157.464540:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649088 00010000:00010000:3.0:1789403157.464562:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 22 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.464584:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648960 00000100:00100000:3.0:1789403157.464588:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648960 00010000:00010000:3.0:1789403157.464599:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 23 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.464619:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403157.464626:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3629:x1876325050649088:12345-0@lo:103: 00010000:00010000:3.0:1789403157.464703:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403157.464710:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 23 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464720:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 23 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464790:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403157.464819:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3629:x1876325050649088:12345-0@lo:103: Request processed in 193us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.464826:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403157.464838:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403157.464844:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3629:x1876325050648960:12345-0@lo:103: 00010000:00010000:3.0:1789403157.464859:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403157.464864:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 22 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464933:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 22 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.464943:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403157.465083:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3629:x1876325050648960:12345-0@lo:103: Request processed in 238us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.465089:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403157.465127:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050648960:0@lo:103: 00000100:00100000:3.0:1789403157.465135:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050649088:0@lo:103: 00010000:00010000:0.0:1789403157.468764:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403157.468797:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050648832:0@lo:103: 00000100:00100000:0.0:1789403157.468886:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.468948:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648832 00000100:00100000:3.0:1789403157.468965:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648832 00010000:00010000:3.0:1789403157.469007:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 22 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.469040:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.469050:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a14 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.469054:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403157.469065:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3627:x1876325050648832:12345-0@lo:103: 00010000:00010000:3.0:1789403157.469079:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403157.469085:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 22 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.469098:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 22 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.469117:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403157.469206:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050648832:0@lo:103: 00000100:00100000:0.0:1789403157.469249:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.469310:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3627:x1876325050648832:12345-0@lo:103: Request processed in 245us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.469319:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789403157.469342:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.469345:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403157.469345:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.469349:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403157.469359:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 21 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.469634:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050649216:0@lo:104: 00000100:00100000:0.0:1789403157.469716:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403157.469889:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.469898:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 21 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.469907:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050649344:0@lo:104: 00000100:00100000:0.0:1789403157.469931:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.469954:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050648704 00000100:00100000:2.0:1789403157.469959:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050648704 00000100:00100000:2.0:1789403157.469987:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649216 00000100:00100000:2.0:1789403157.469990:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649216 00000100:00100000:2.0:1789403157.470002:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403157.470009:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6493:x1876325050648704:12345-0@lo:104: 00010000:00010000:2.0:1789403157.470019:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470078:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403157.470084:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6493:x1876325050648704:12345-0@lo:104: Request processed in 76us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.470091:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403157.470105:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789403157.470111:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6493:x1876325050649216:12345-0@lo:104: 00010000:00010000:2.0:1789403157.470117:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470149:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403157.470154:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6493:x1876325050649216:12345-0@lo:104: Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.470159:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789403157.470174:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403157.470179:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470186:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403157.470190:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470212:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403157.470219:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403157.470225:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403157.470250:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470256:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403157.470271:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470278:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0000/0x5fb08b1e5b7609a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609ab expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470288:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403157.470291:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470296:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403157.470299:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470305:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.470403:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789403157.470586:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403157.470598:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403157.470613:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470618:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403157.470623:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470630:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76098f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.470812:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403157.470814:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403157.470815:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403157.470828:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050649472:0@lo:103: 00000100:00100000:2.0:1789403157.470861:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.470890:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403157.470895:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050649600:0@lo:103: 00000100:00100000:2.0:1789403157.470915:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.470950:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649472 00000100:00100000:2.0:1789403157.470955:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649472 00010000:00010000:2.0:1789403157.470973:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 22 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.470998:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649600 00000100:00100000:2.0:1789403157.471001:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649600 00010000:00010000:2.0:1789403157.471011:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 23 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.471053:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403157.471060:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a607c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3626:x1876325050649472:12345-0@lo:103: 00010000:00010000:2.0:1789403157.471070:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403157.471075:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 23 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.471084:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 23 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.471096:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403157.471124:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a607c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3626:x1876325050649472:12345-0@lo:103: Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.471130:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403157.471167:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789403157.471173:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3626:x1876325050649600:12345-0@lo:103: 00010000:00010000:2.0:1789403157.471182:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403157.471186:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 22 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.471194:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 22 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.471203:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403157.471223:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3626:x1876325050649600:12345-0@lo:103: Request processed in 50us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.471228:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789403157.471256:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050649600:0@lo:103: 00000100:00100000:2.0:1789403157.471273:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050649472:0@lo:103: 00010000:00010000:0.0:1789403157.471775:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.471785:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 21 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.471795:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050649728:0@lo:104: 00000100:00100000:0.0:1789403157.471816:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789403157.471830:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760a14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760a0d expref: 21 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.471841:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648320:0@lo:104: 00010000:00010000:0.0:1789403157.471861:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185200/0x5fb08b1e5b7609f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ea expref: 20 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.471869:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648448:0@lo:104: 00010000:00010000:0.0:1789403157.471878:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b7609d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7609ce expref: 19 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.471886:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648576:0@lo:104: 00010000:00010000:0.0:1789403157.471895:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b7609ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7609a4 expref: 18 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.471902:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050648704:0@lo:104: 00010000:00010000:0.0:1789403157.471910:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b76098f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760988 expref: 17 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.471917:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050649216:0@lo:104: 00000100:00100000:2.0:1789403157.471961:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789403157.471978:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.471988:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649344 00000100:00100000:2.0:1789403157.471993:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649344 00000100:00100000:2.0:1789403157.472013:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649728 00000100:00100000:2.0:1789403157.472016:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649728 00000100:00100000:2.0:1789403157.472037:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403157.472043:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27db09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6493:x1876325050649344:12345-0@lo:104: 00010000:00010000:2.0:1789403157.472052:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472139:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403157.472145:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27db09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6493:x1876325050649344:12345-0@lo:104: Request processed in 102us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.472151:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403157.472186:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789403157.472192:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6493:x1876325050649728:12345-0@lo:104: 00010000:00010000:2.0:1789403157.472199:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472231:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403157.472236:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6493:x1876325050649728:12345-0@lo:104: Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.472242:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789403157.472257:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403157.472262:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472280:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a26e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403157.472284:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472292:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403157.472297:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403157.472303:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403157.472583:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403157.472589:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.472596:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403157.472599:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.472605:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403157.472611:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403157.472616:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403157.472676:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472683:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403157.472700:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472707:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760950 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.472727:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050649856:0@lo:103: 00000100:00100000:2.0:1789403157.472757:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.472786:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649856 00000100:00100000:2.0:1789403157.472790:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649856 00010000:00010000:2.0:1789403157.472806:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 17 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.472826:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403157.472839:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:3628:x1876325050649856:12345-0@lo:103: 00010000:00010000:2.0:1789403157.472847:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403157.472852:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 17 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472862:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 17 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.472873:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403157.472899:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:3628:x1876325050649856:12345-0@lo:103: Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.472906:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789403157.472933:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050649856:0@lo:103: 00010000:00010000:0.0:1789403157.473111:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760949 expref: 16 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.473122:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050649344:0@lo:104: 00000100:00100000:0.0:1789403157.473130:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876325050649728:0@lo:104: 00010000:00010000:0.0:1789403157.473154:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.473202:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.473209:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789403157.473245:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050649984:0@lo:103: 00000100:00100000:0.0:1789403157.473269:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403157.473321:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.473335:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270185c00/0x5fb08b1e5b76091f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760926 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.473347:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403157.473349:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403157.473351:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403157.473944:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050649984 00000100:00100000:2.0:1789403157.473950:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050649984 00010000:00010000:2.0:1789403157.473971:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 16 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.474482:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.474486:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.474489:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403157.477750:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789403157.477772:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3629:x1876325050649984:12345-0@lo:103: 00010000:00010000:2.0:1789403157.477791:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403157.477800:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 16 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477814:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 16 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477832:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b760926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76091f expref: 16 pid: 6493 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477864:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477873:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477889:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477896:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477902:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477909:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477915:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403157.477919:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477927:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477944:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.477954:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403157.478893:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3629:x1876325050649984:12345-0@lo:103: Request processed in 1127us (5618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.478916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789403157.479097:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050649984:0@lo:103: 00010000:00010000:0.0:1789403157.479141:0:6493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.479152:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.479159:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a30 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789403157.479175:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789403157.500744:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:9493:x1876325050648192:12345-0@lo:253: Request processed in 52785us (54731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.500758:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789403157.501120:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050648192:0@lo:253: 10000000:01000000:3.0:1789403157.501138:0:9493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789403157.501142:0:9493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403157.501143:0:9493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403157.501145:0:9493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403157.501146:0:9493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789403157.501147:0:9493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403157.501149:0:9493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403157.501150:0:9493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403157.501152:0:9493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789403157.501154:0:9493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403157.501155:0:9493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789403157.501179:0:9493:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a1424b5800 from lustre-OST0001 10000000:01000000:3.0:1789403157.501221:0:9493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789403157.501224:0:9493:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789403157.501234:0:9493:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a245c9b380 local copy 10000000:01000000:3.0:1789403157.501239:0:9493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789403157.501277:0:9493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.501289:0:9493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.501299:0:9493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.501332:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650112:0@lo:101: 00000100:00100000:3.0:1789403157.501367:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.501433:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403157.501582:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650112 00000100:00100000:0.0:1789403157.501590:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650112 00000100:00100000:0.0:1789403157.501642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789403157.501652:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+14:9493:x1876325050650112:12345-0@lo:101: 00010000:00010000:0.0:1789403157.501663:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403157.501676:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760a37 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.501701:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a37 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.501712:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a37 expref: 15 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.501721:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1400, rc 0) 00000100:00100000:0.0:1789403157.501885:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650112:12345-0@lo:101: Request processed in 235us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403157.501892:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789403157.501944:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650112:0@lo:101: 00010000:00010000:2.0:1789403157.501960:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.501970:0:9493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.502086:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650240:0@lo:501: 00000100:00100000:2.0:1789403157.502117:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.502151:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403157.502216:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650240 00000100:00100000:1.0:1789403157.502221:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650240 00000100:00100000:1.0:1789403157.502255:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789403157.502262:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650240:12345-0@lo:501: 00000100:00100000:1.0:1789403157.502333:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650240:12345-0@lo:501: Request processed in 71us (214us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403157.502339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789403157.502570:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650240:0@lo:501: 10000000:01000000:2.0:1789403157.502587:0:9493:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789403157.502603:0:9493:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789403157.502609:0:9493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.502617:0:9493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.502624:0:9493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.502656:0:9493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789403157.502679:0:9493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a1424b5800 10000000:01000000:2.0:1789403157.502684:0:9493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789403157.502689:0:9493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789403157.502703:0:9493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789403157.502708:0:9493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789403157.502711:0:9493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789403157.502729:0:9493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.502737:0:9493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.502746:0:9493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.502759:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650368:0@lo:101: 00000100:00100000:2.0:1789403157.502786:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.502799:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403157.502900:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650368 00000100:00100000:0.0:1789403157.502905:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650368 00010000:00010000:3.0:1789403157.502922:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403157.502934:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.502942:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00010000:00010000:3.0:1789403157.502944:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403157.502949:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403157.502952:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650368:12345-0@lo:101: 00010000:00010000:3.0:1789403157.502963:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.502965:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:00010000:3.0:1789403157.502974:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.502978:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760a45 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403157.502980:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403157.503003:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.503011:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403157.503011:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.503030:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.503038:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1c00, rc 0) 00010000:00010000:3.0:1789403157.503043:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.503051:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5fb08b1e5b760a3e expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.503063:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403157.503074:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050650368:12345-0@lo:101: Request processed in 123us (286us total) trans 0 rc 0/0 00010000:00010000:3.0:1789403157.503075:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.503079:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403157.503084:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789403157.503098:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050650496:0@lo:103: 00000100:00100000:3.0:1789403157.503132:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.503238:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650368:0@lo:101: 00010000:00010000:2.0:1789403157.503249:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.503258:0:9493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.503710:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650624:0@lo:501: 00000100:00100000:2.0:1789403157.503743:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.503805:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403157.503883:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650496 00000100:00100000:0.0:1789403157.503890:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650496 00000100:00100000:0.0:1789403157.504111:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403157.504119:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3626:x1876325050650496:12345-0@lo:103: 00010000:00010000:0.0:1789403157.504129:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403157.504149:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760a3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760a37 expref: 16 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.504162:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403157.504210:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3626:x1876325050650496:12345-0@lo:103: Request processed in 85us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403157.504218:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403157.504245:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050650496:0@lo:103: 00000100:00100000:3.0:1789403157.504296:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650624 00000100:00100000:3.0:1789403157.504300:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650624 00000100:00100000:3.0:1789403157.504476:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789403157.504484:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650624:12345-0@lo:501: 00000100:00100000:3.0:1789403157.504723:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650624:12345-0@lo:501: Request processed in 240us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.504729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789403157.504783:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650624:0@lo:501: 00000100:00100000:2.0:1789403157.504820:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650752:0@lo:503: 00000100:00100000:2.0:1789403157.504866:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.505087:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403157.505131:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650752 00000100:00100000:3.0:1789403157.505136:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650752 00000100:00100000:3.0:1789403157.505167:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789403157.505174:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650752:12345-0@lo:503: 00000100:00100000:3.0:1789403157.505306:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650752:12345-0@lo:503: Request processed in 132us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.505321:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789403157.505667:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650752:0@lo:503: 00000040:00080000:3.0:1789403157.506811:0:9493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403157.506992:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650880:0@lo:502: 00000100:00100000:3.0:1789403157.507064:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.507155:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403157.507200:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050650880 00000100:00100000:0.0:1789403157.507213:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050650880 00000100:00100000:0.0:1789403157.507285:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789403157.507295:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650880:12345-0@lo:502: 00000100:00100000:0.0:1789403157.507445:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050650880:12345-0@lo:502: Request processed in 151us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403157.507451:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789403157.507549:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050650880:0@lo:502: 00000040:00080000:2.0:1789403157.507763:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789403157.507790:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789403157.507803:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789403157.507817:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789403157.507831:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789403157.507846:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789403157.507869:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651008:0@lo:502: 00000100:00100000:2.0:1789403157.508491:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.509012:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403157.509109:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651008 00000100:00100000:3.0:1789403157.509118:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651008 00000100:00100000:3.0:1789403157.509156:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789403157.509165:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050651008:12345-0@lo:502: 00000100:00100000:3.0:1789403157.509287:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050651008:12345-0@lo:502: Request processed in 122us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.509302:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789403157.509582:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651008:0@lo:502: 00000040:00080000:2.0:1789403157.509651:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789403157.509663:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1789403157.510916:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789403157.510926:0:9504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789403157.510932:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403157.510935:0:9504:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789403157.510941:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403157.510957:0:9504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a27c363380) 00000020:00000080:2.0:1789403157.510979:0:9504:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789403157.510985:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789403157.511089:0:9504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a1424b5800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789403157.511098:0:9504:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789403157.511106:0:9504:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5fb08b1e5b760a5a 00010000:00010000:3.0:1789403157.531935:0:9504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789403157.532505:0:9504:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789403157.543017:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789403157.544282:0:9504:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789403157.554210:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789403157.554481:0:9504:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789403157.564354:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789403157.566054:0:9504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789403157.566066:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403157.566073:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403157.566075:0:9504:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789403157.566079:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403157.566084:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403157.566086:0:9504:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789403157.566089:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789403157.566091:0:9504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789403157.566114:0:9504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403157.566117:0:9504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403157.566119:0:9504:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789403157.566122:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789403157.566342:0:9493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789403157.566380:0:9493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789403157.566425:0:9493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.566437:0:9493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403157.566446:0:9493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a1424b5800 from 1 10000000:01000000:3.0:1789403157.566450:0:9493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403157.566485:0:9493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.566493:0:9493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.566504:0:9493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.566540:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651136:0@lo:101: 00000100:00100000:3.0:1789403157.566612:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.566668:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403157.566849:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651136 00000100:00100000:1.0:1789403157.566858:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651136 00000100:00100000:1.0:1789403157.566907:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789403157.566917:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050651136:12345-0@lo:101: 00010000:00010000:1.0:1789403157.566930:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403157.566942:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760a61 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.566966:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.566989:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.566998:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27000, rc 0) 00000100:00100000:1.0:1789403157.567048:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651136:12345-0@lo:101: Request processed in 132us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.567056:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789403157.567269:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651136:0@lo:101: 00010000:00010000:3.0:1789403157.567284:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.567303:0:9493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.567429:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651264:0@lo:501: 00000100:00100000:3.0:1789403157.567457:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.567476:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403157.567627:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651264 00000100:00100000:1.0:1789403157.567633:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651264 00000100:00100000:1.0:1789403157.567676:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789403157.567683:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651264:12345-0@lo:501: 00000100:00100000:1.0:1789403157.567785:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651264:12345-0@lo:501: Request processed in 102us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.567792:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789403157.567965:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651264:0@lo:501: 00000100:00100000:3.0:1789403157.567993:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651392:0@lo:503: 00000100:00100000:3.0:1789403157.568046:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.568075:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403157.568825:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651392 00000100:00100000:1.0:1789403157.568833:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651392 00000100:00100000:1.0:1789403157.568874:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789403157.568882:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651392:12345-0@lo:503: 00000100:00100000:1.0:1789403157.568994:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651392:12345-0@lo:503: Request processed in 113us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.569000:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789403157.569627:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651392:0@lo:503: 00000040:00080000:2.0:1789403157.569983:0:9493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403157.570062:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651520:0@lo:502: 00000100:00100000:2.0:1789403157.570110:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.570145:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cd2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403157.572947:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651520 00000100:00100000:3.0:1789403157.572962:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651520 00000100:00100000:3.0:1789403157.573015:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789403157.573034:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651520:12345-0@lo:502: 00000100:00100000:3.0:1789403157.573185:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651520:12345-0@lo:502: Request processed in 161us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.573192:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789403157.573670:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651520:0@lo:502: 00000040:00080000:3.0:1789403157.577217:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789403157.577275:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789403157.577327:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651648:0@lo:502: 00000100:00100000:3.0:1789403157.577449:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.577486:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426759c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403157.577888:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651648 00000100:00100000:1.0:1789403157.577897:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651648 00000100:00100000:1.0:1789403157.577949:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789403157.577958:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651648:12345-0@lo:502: 00000100:00100000:1.0:1789403157.578098:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651648:12345-0@lo:502: Request processed in 140us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.578111:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789403157.578212:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651648:0@lo:502: 00000040:00080000:2.0:1789403157.578264:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789403157.578273:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789403157.578976:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403157.578987:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403157.578989:0:9507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789403157.578996:0:9507:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a1424b5800 00000020:00000080:2.0:1789403157.578999:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403157.579011:0:9507:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403157.579030:0:9507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403157.579032:0:9507:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789403157.579035:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789403157.579647:0:9493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789403157.579675:0:9493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403157.579696:0:9493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.579708:0:9493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403157.579862:0:9493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789403157.579866:0:9493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a1424b5800 10000000:01000000:1.0:1789403157.579869:0:9493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a1424b5800 10000000:01000000:1.0:1789403157.579873:0:9493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403157.579879:0:9493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a1424b5800 from 1 10000000:01000000:1.0:1789403157.579883:0:9493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403157.579915:0:9493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.579924:0:9493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403157.579934:0:9493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403157.579955:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651776:0@lo:101: 00000100:00100000:1.0:1789403157.580011:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403157.580064:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403157.580485:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651776 00000100:00100000:3.0:1789403157.580493:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651776 00000100:00100000:3.0:1789403157.580551:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789403157.580560:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9493:x1876325050651776:12345-0@lo:101: 00010000:00010000:3.0:1789403157.580580:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403157.580593:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760a6f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.580615:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.580626:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.580635:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185e00, rc 0) 00000100:00100000:3.0:1789403157.580690:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050651776:12345-0@lo:101: Request processed in 132us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.580696:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789403157.582604:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651776:0@lo:101: 00010000:00010000:3.0:1789403157.582648:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.582661:0:9493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.582904:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651904:0@lo:501: 00000100:00100000:3.0:1789403157.582962:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.583003:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403157.583208:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050651904 00000100:00100000:2.0:1789403157.583215:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050651904 00000100:00100000:2.0:1789403157.583254:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789403157.583261:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050651904:12345-0@lo:501: 00000100:00100000:2.0:1789403157.583411:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050651904:12345-0@lo:501: Request processed in 149us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.583418:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789403157.583853:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050651904:0@lo:501: 00000100:00100000:0.0:1789403157.583889:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050652032:0@lo:503: 00000100:00100000:0.0:1789403157.583935:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403157.583966:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403157.584793:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652032 00000100:00100000:2.0:1789403157.584802:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652032 00000100:00100000:2.0:1789403157.584839:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789403157.584848:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050652032:12345-0@lo:503: 00000100:00100000:2.0:1789403157.584962:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050652032:12345-0@lo:503: Request processed in 115us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.584969:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789403157.585134:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050652032:0@lo:503: 00000040:00080000:0.0:1789403157.586596:0:9493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403157.586983:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050652160:0@lo:502: 00000100:00100000:0.0:1789403157.587064:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403157.587145:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403157.595916:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652160 00000100:00100000:3.0:1789403157.595930:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652160 00000100:00100000:3.0:1789403157.595986:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789403157.595996:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050652160:12345-0@lo:502: 00000100:00100000:3.0:1789403157.596201:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050652160:12345-0@lo:502: Request processed in 206us (9136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.596210:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789403157.596669:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050652160:0@lo:502: 00000040:00080000:0.0:1789403157.596992:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789403157.597039:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789403157.597059:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789403157.597074:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789403157.597090:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789403157.597105:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789403157.597120:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789403157.597137:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789403157.597152:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789403157.597166:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789403157.597179:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789403157.597205:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789403157.597220:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789403157.597232:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789403157.597244:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789403157.597255:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789403157.597267:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789403157.597298:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789403157.597313:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789403157.597325:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789403157.597339:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789403157.597351:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789403157.597363:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789403157.597427:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789403157.597445:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789403157.597459:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789403157.597472:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789403157.597486:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789403157.597500:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789403157.597514:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789403157.598152:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789403157.598171:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789403157.598196:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789403157.598209:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789403157.598223:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789403157.598236:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789403157.598249:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789403157.598261:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789403157.598274:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789403157.598287:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789403157.598301:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789403157.598314:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789403157.598328:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789403157.598342:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789403157.598356:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789403157.598876:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789403157.598925:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050652288:0@lo:502: 00000100:00100000:1.0:1789403157.599005:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403157.599055:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403157.599114:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652288 00000100:00100000:3.0:1789403157.599122:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652288 00000100:00100000:3.0:1789403157.599176:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789403157.599186:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050652288:12345-0@lo:502: 00000100:00100000:3.0:1789403157.599296:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050652288:12345-0@lo:502: Request processed in 111us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.599303:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789403157.599464:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050652288:0@lo:502: 00000040:00080000:1.0:1789403157.599511:0:9493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789403157.599531:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1789403157.600358:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789403157.600626:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a14264b380) 00000020:00000080:0.0:1789403157.600812:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789403157.600896:0:9509:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a1424b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789403157.600899:0:9509:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a1424b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789403157.600902:0:9509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a1424b5800 3 00010000:00080000:0.0:1789403157.600929:0:9509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a14278f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403157.603939:0:9509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789403157.604229:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789403157.604271:0:9509:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789403157.604283:0:9509:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5fb08b1e5b760a84 00000100:00080000:0.0:1789403157.604295:0:9509:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403157.604305:0:9509:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a14278f000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403157.604342:0:9509:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a274f7b800 x1876325050652416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403157.604372:0:9509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789403157.604472:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050652416:0@lo:38: 00000100:00100000:2.0:1789403157.604547:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403157.604697:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652416 00000100:00100000:0.0:1789403157.604706:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652416 00000100:00100000:0.0:1789403157.604825:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403157.604832:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050652416:12345-0@lo:38: 00010000:00080000:0.0:1789403157.604857:0:6501:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1789403157.604884:0:6501:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb08b1e5b760a8b 00000004:00100000:0.0:1789403157.604897:0:6501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789403157.604929:0:6501:0:(import.c:65:import_set_state_nolock()) ffff90a281820800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403157.604978:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876325050652416:12345-0@lo:38: Request processed in 145us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403157.604985:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403157.605218:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050652928:0@lo:400: 00000100:00100000:3.0:1789403157.605249:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605269:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050653440:0@lo:400: 00000100:00100000:3.0:1789403157.605288:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605305:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789403157.605310:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050652544:0@lo:400: 00000100:00100000:3.0:1789403157.605337:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605356:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050653056:0@lo:400: 00000100:00100000:3.0:1789403157.605412:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605437:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050652800:0@lo:400: 00000100:00100000:3.0:1789403157.605459:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605474:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050653312:0@lo:400: 00000100:00100000:3.0:1789403157.605492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605509:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789403157.605514:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050652672:0@lo:400: 00000100:00100000:3.0:1789403157.605614:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605632:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050653184:0@lo:400: 00000100:00100000:3.0:1789403157.605666:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.605688:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652928 00000100:00100000:3.0:1789403157.605693:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652928 00000100:00100000:3.0:1789403157.605719:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652672 00000100:00100000:3.0:1789403157.605722:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652672 00000100:00100000:3.0:1789403157.605919:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403157.605927:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050652928:12345-0@lo:400: 00000100:00100000:3.0:1789403157.605969:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050652928:12345-0@lo:400: Request processed in 44us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.605975:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403157.605991:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403157.605997:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050652672:12345-0@lo:400: 00000100:00100000:3.0:1789403157.606040:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050652672:12345-0@lo:400: Request processed in 43us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.606046:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403157.606066:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653440 00000100:00100000:3.0:1789403157.606070:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653440 00000100:00100000:3.0:1789403157.606098:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653312 00000100:00100000:3.0:1789403157.606101:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653312 00000100:00100000:3.0:1789403157.606122:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403157.606127:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050653440:12345-0@lo:400: 00000100:00100000:3.0:1789403157.606156:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050653440:12345-0@lo:400: Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.606162:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403157.606172:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403157.606178:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050653312:12345-0@lo:400: 00000100:00100000:3.0:1789403157.606213:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050653312:12345-0@lo:400: Request processed in 35us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.606219:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403157.606237:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652544 00000100:00100000:3.0:1789403157.606240:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652544 00000100:00100000:3.0:1789403157.606257:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653056 00000100:00100000:3.0:1789403157.606260:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653056 00000100:00100000:3.0:1789403157.606273:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050652800 00000100:00100000:3.0:1789403157.606275:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050652800 00000100:00100000:3.0:1789403157.606285:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653184 00000100:00100000:3.0:1789403157.606287:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653184 00000100:00100000:3.0:1789403157.606300:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403157.606305:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050652544:12345-0@lo:400: 00000100:00100000:3.0:1789403157.606335:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050652544:12345-0@lo:400: Request processed in 29us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.606340:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403157.606351:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403157.606356:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050653056:12345-0@lo:400: 00000100:00100000:3.0:1789403157.606424:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050653056:12345-0@lo:400: Request processed in 67us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.606430:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403157.606441:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403157.606446:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050652800:12345-0@lo:400: 00000100:00100000:3.0:1789403157.606471:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050652800:12345-0@lo:400: Request processed in 25us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.606476:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403157.606487:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789403157.606493:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050653184:12345-0@lo:400: 00000100:00080000:1.0:1789403157.614237:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403157.614246:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403157.614249:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403157.614362:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f7b800 x1876325050652416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403157.614376:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403157.614386:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789403157.614406:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789403157.614411:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789403157.614415:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403157.614422:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050652416:0@lo:38: 00000020:01000004:0.0:1789403157.614799:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789403157.614815:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90a14264cd40) 00000020:00000080:0.0:1789403157.614840:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789403157.614938:0:9509:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a1424b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789403157.614943:0:9509:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a1424b5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789403157.614945:0:9509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a1424b5800 3 00010000:00080000:0.0:1789403157.614975:0:9509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a14338c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.143@tcp at head 00000100:00100000:2.0:1789403157.615620:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9511:1876325050653568:0@lo:901: 00000100:00100000:2.0:1789403157.615693:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.615741:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653568 00000100:00100000:2.0:1789403157.615747:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653568 00000100:00100000:2.0:1789403157.615793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403157.615801:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9511:x1876325050653568:12345-0@lo:901: 00000100:00100000:2.0:1789403157.615879:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9511:x1876325050653568:12345-0@lo:901: Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.615886:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789403157.615907:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403157.615916:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cd2000 going to sleep for 11 seconds 00010000:00080000:2.0:1789403157.615933:0:9511:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a64b480 x1876325050653568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789403173 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403157.615945:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9511:1876325050653568:0@lo:901: 00000100:00100000:3.0:1789403157.617811:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050653184:12345-0@lo:400: Request processed in 11308us (12133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403157.617825:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789403157.618548:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f2c700 x1876325050652544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403157.618565:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050652544:0@lo:400: 00010000:00080000:2.0:1789403157.618578:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f2c000 x1876325050653056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403157.618587:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050653056:0@lo:400: 00000100:00100000:2.0:1789403157.618599:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050652928:0@lo:400: 00010000:00080000:2.0:1789403157.618610:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050653440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403157.618617:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050653440:0@lo:400: 00010000:00010000:0.0:1789403157.619264:0:9509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:1.0:1789403157.620664:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050652672:0@lo:400: 00010000:00080000:1.0:1789403157.620684:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f2e300 x1876325050653184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403157.620695:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050653184:0@lo:400: 00010000:00080000:1.0:1789403157.620705:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f2ca80 x1876325050652800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403157.620725:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050652800:0@lo:400: 00000020:00000080:0.0:1789403157.620937:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789403157.620986:0:9509:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789403157.620999:0:9509:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5fb08b1e5b760a99 00000100:00080000:0.0:1789403157.621006:0:9509:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403157.621015:0:9509:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a14338c000 using connection 192.168.203.143@tcp/0@lo 00010000:00080000:1.0:1789403157.621485:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f2f100 x1876325050653312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403157.621496:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050653312:0@lo:400: 00000100:00100000:0.0:1789403157.621839:0:9509:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a274f79c00 x1876325050653696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403157.621912:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050653696:0@lo:38: 00000100:00100000:3.0:1789403157.621975:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403157.622067:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653696 00000100:00100000:1.0:1789403157.622074:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653696 00000100:00100000:1.0:1789403157.622107:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403157.622114:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050653696:12345-0@lo:38: 00010000:00080000:1.0:1789403157.622140:0:6500:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1789403157.622171:0:6500:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5fb08b1e5b760aa0 00000004:00100000:1.0:1789403157.622185:0:6500:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403157.622213:0:6500:0:(import.c:65:import_set_state_nolock()) ffff90a14278e000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789403157.623883:0:9509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1789403157.625812:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789403157.625921:0:9493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789403157.625951:0:9493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403157.625973:0:9493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403157.625985:0:9493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789403157.626046:0:9493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789403157.626048:0:9493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789403157.626049:0:9493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403157.626050:0:9493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403157.626051:0:9493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403157.626053:0:9493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403157.626054:0:9493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403157.626056:0:9493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789403157.626057:0:9493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789403157.626059:0:9493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403157.626060:0:9493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403157.626064:0:9493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789403157.626066:0:9493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789403157.626068:0:9493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789403157.626069:0:9493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403157.626070:0:9493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403157.626071:0:9493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403157.626072:0:9493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403157.626073:0:9493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403157.626074:0:9493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789403157.626075:0:9493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789403157.626076:0:9493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403157.626077:0:9493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403157.626102:0:9493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789403157.626118:0:9493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050653824:0@lo:253: 00000100:00100000:0.0:1789403157.626190:0:9493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403157.626216:0:9493:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789403157.626271:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653824 00000100:00100000:0.0:1789403157.626278:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653824 00000100:00100000:0.0:1789403157.626320:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789403157.626328:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9493:x1876325050653824:12345-0@lo:253: 20000000:01000000:0.0:1789403157.626352:0:6493:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789403157.626375:0:6493:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789403157.628227:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876325050653696:12345-0@lo:38: Request processed in 6104us (6244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.628241:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789403157.631271:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a274f79c00 x1876325050653696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403157.631287:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403157.631296:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789403157.631305:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789403157.631310:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789403157.631314:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14338c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789403157.631321:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050653696:0@lo:38: 20000000:01000000:0.0:1789403157.635721:0:6493:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789403157.635748:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789403157.635960:0:6515:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789403157.635965:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789403157.635987:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.636006:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.636014:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.636032:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.636076:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 17 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.636103:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 17 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.636118:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050653952:0@lo:104: 00000100:00100000:3.0:1789403157.636181:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403157.636231:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.636240:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 17 pid: 6492 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.636248:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050654080:0@lo:104: 00000100:00100000:3.0:1789403157.636268:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403157.636287:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675180 going to sleep for 11 seconds 00000100:00100000:2.0:1789403157.636346:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050653952 00000100:00100000:2.0:1789403157.636355:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050653952 00000100:00100000:2.0:1789403157.636425:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654080 00000100:00100000:2.0:1789403157.636428:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654080 00000100:00100000:2.0:1789403157.636445:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403157.636452:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6515:x1876325050653952:12345-0@lo:104: 00010000:00010000:2.0:1789403157.636464:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636528:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403157.636533:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:6515:x1876325050653952:12345-0@lo:104: Request processed in 82us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.636539:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403157.636556:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403157.636561:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050654080:12345-0@lo:104: 00010000:00010000:2.0:1789403157.636569:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636602:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403157.636606:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:6515:x1876325050654080:12345-0@lo:104: Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.636612:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789403157.636628:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403157.636634:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636640:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403157.636644:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636660:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403157.636667:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403157.636673:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403157.636698:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636703:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403157.636718:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636724:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b7609dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7609e3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636750:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403157.636753:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636757:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403157.636760:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636765:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403157.636771:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403157.636781:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403157.636795:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636800:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403157.636814:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636821:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b760996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76099d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.636833:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403157.636835:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403157.636837:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403157.636851:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403157.636862:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050654208:0@lo:103: 00000100:00100000:2.0:1789403157.636891:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.636925:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050654336:0@lo:103: 00000100:00100000:2.0:1789403157.636949:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403157.636975:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654208 00000100:00100000:2.0:1789403157.636979:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654208 00010000:00010000:2.0:1789403157.636997:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 18 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.637015:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654336 00000100:00100000:2.0:1789403157.637017:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654336 00010000:00010000:2.0:1789403157.637040:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 19 pid: 6492 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403157.637068:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403157.637074:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3626:x1876325050654208:12345-0@lo:103: 00010000:00010000:2.0:1789403157.637085:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403157.637090:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 19 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637100:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 19 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637115:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403157.637140:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3626:x1876325050654208:12345-0@lo:103: Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.637146:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403157.637159:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403157.637165:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:3628:x1876325050654336:12345-0@lo:103: 00010000:00010000:2.0:1789403157.637172:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403157.637175:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 18 pid: 6492 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637183:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 18 pid: 6492 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637194:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637201:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789403157.637224:0:7451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020350140s 00010000:00010000:2.0:1789403157.637229:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637237:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637242:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637248:0:7451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637253:0:7451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403157.637257:0:7451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637264:0:7451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637272:0:7451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403157.637280:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403157.637308:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:3628:x1876325050654336:12345-0@lo:103: Request processed in 144us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403157.637314:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403157.637352:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050654336:0@lo:103: 00000100:00100000:2.0:1789403157.637375:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050654208:0@lo:103: 00010000:00010000:1.0:1789403157.637635:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403157.637705:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b7609e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7609dc expref: 17 pid: 6495 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.637716:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050653952:0@lo:104: 00010000:00010000:3.0:1789403157.637735:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184200/0x5fb08b1e5b76099d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760996 expref: 16 pid: 6492 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403157.637743:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6515:1876325050654080:0@lo:104: 00010000:00010000:3.0:1789403157.637757:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.637766:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.637783:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403157.637789:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760aa7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403157.638114:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:9493:x1876325050653824:12345-0@lo:253: Request processed in 11785us (11923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403157.638122:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789403157.638240:0:9493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9493:1876325050653824:0@lo:253: 10000000:01000000:0.0:1789403157.638251:0:9493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789403157.638254:0:9493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789403157.638256:0:9493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789403157.638258:0:9493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403157.638259:0:9493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403157.638261:0:9493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403157.638262:0:9493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403157.638264:0:9493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403157.638265:0:9493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789403157.638267:0:9493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789403157.638268:0:9493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403157.638269:0:9493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789403157.638279:0:9493:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789403157.645361:0:9493:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789403157.645625:0:9493:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789403157.645832:0:9493:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789403157.645985:0:9493:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789403157.646488:0:9493:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789403157.647002:0:9493:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789403157.650915:0:9493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789403157.682368:0:9493:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789403157.682379:0:9493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789403157.682436:0:9493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789403157.682479:0:9493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789403157.682500:0:9493:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789403157.682514:0:9493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789403157.683238:0:9493:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403157.683436:0:9493:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789403158.002619:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403158.640111:0:9567:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403158.640602:0:9567:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789403159.027304:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403160.050725:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403160.306368:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050654464:0@lo:13: 00000100:00100000:2.0:1789403160.306468:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403160.306861:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654464 00000100:00100000:3.0:1789403160.306869:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654464 00000100:00100000:3.0:1789403160.306940:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789403160.306951:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050654464:12345-0@lo:13: 00002000:00000024:3.0:1789403160.306981:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403160.307043:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050654464:12345-0@lo:13: Request processed in 95us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403160.307050:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789403160.307101:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143383100 x1876325050654464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403160.307239:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403160.307853:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050654464:0@lo:13: 00000100:00100000:3.0:1789403160.321509:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403160.321536:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050654592:0@lo:13: 00000100:00100000:3.0:1789403160.321601:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403160.321889:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654592 00000100:00100000:1.0:1789403160.321897:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654592 00000100:00100000:1.0:1789403160.321958:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403160.321969:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050654592:12345-0@lo:13: 00002000:00000024:1.0:1789403160.321992:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403160.322052:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050654592:12345-0@lo:13: Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403160.322059:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789403160.322109:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251f480 x1876325050654592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403160.324261:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050654592:0@lo:13: 00000100:00080000:3.0:1789403160.324864:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403160.820204:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403160.820230:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050654720:0@lo:41: 00000100:00100000:0.0:1789403160.820305:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403160.820380:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654720 00000100:00100000:0.0:1789403160.820405:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654720 00000100:00100000:0.0:1789403160.820449:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403160.820457:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050654720:12345-0@lo:41: 00000004:00000024:0.0:1789403160.820504:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789403160.820549:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050654720:12345-0@lo:41: Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403160.820556:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403160.820682:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050654720:0@lo:41: 00010000:00010000:2.0:1789403161.073677:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403161.841794:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050654848:0@lo:41: 00000100:00100000:3.0:1789403161.841866:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403161.842012:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654848 00000100:00100000:0.0:1789403161.842024:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654848 00000100:00100000:0.0:1789403161.842077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403161.842087:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050654848:12345-0@lo:41: 00000004:00000024:0.0:1789403161.842120:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789403161.842176:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050654848:12345-0@lo:41: Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403161.842184:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789403161.842541:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050654848:0@lo:41: 00010000:00010000:3.0:1789403162.102177:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403162.865752:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050655104:0@lo:400: 00000100:00100000:2.0:1789403162.865824:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403162.865878:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050655616:0@lo:400: 00000100:00100000:2.0:1789403162.865899:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403162.865918:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050654976:0@lo:400: 00000100:00100000:2.0:1789403162.865920:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050656128:0@lo:400: 00000100:00100000:2.0:1789403162.865939:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403162.865948:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403162.865963:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789403162.865969:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050655488:0@lo:400: 00000100:00100000:2.0:1789403162.865969:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050655232:0@lo:400: 00000100:00100000:3.0:1789403162.866008:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050655360:0@lo:400: 00000100:00100000:2.0:1789403162.866018:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403162.866030:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403162.866040:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050655744:0@lo:400: 00000100:00100000:3.0:1789403162.866044:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050655872:0@lo:400: 00000100:00100000:2.0:1789403162.866059:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403162.866060:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403162.866069:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050656256:0@lo:400: 00000100:00100000:2.0:1789403162.866090:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403162.866091:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655104 00000100:00100000:3.0:1789403162.866098:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655104 00000100:00100000:2.0:1789403162.866115:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655616 00000100:00100000:2.0:1789403162.866118:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655616 00000100:00100000:3.0:1789403162.866131:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656128 00000100:00100000:3.0:1789403162.866133:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656128 00000100:00100000:2.0:1789403162.866141:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655360 00000100:00100000:2.0:1789403162.866143:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655360 00000100:00100000:3.0:1789403162.866144:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655744 00000100:00100000:3.0:1789403162.866146:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655744 00000100:00100000:3.0:1789403162.866157:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656256 00000100:00100000:3.0:1789403162.866159:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656256 00000100:00100000:2.0:1789403162.866172:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789403162.866184:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050655104:12345-0@lo:400: 00000100:00100000:2.0:1789403162.866237:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050655104:12345-0@lo:400: Request processed in 54us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867272:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403162.867290:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050655616:12345-0@lo:400: 00000100:00100000:3.0:1789403162.867339:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050655616:12345-0@lo:400: Request processed in 58us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867345:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403162.867368:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789403162.867375:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050656128:12345-0@lo:400: 00000100:00100000:3.0:1789403162.867416:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050656128:12345-0@lo:400: Request processed in 42us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867422:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789403162.867437:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403162.867450:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050655744:12345-0@lo:400: 00000100:00100000:3.0:1789403162.867482:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050655744:12345-0@lo:400: Request processed in 33us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867488:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403162.867500:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789403162.867506:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050655360:12345-0@lo:400: 00000100:00100000:3.0:1789403162.867539:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050655360:12345-0@lo:400: Request processed in 33us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867544:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789403162.867555:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403162.867562:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050656256:12345-0@lo:400: 00000100:00100000:3.0:1789403162.867586:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050656256:12345-0@lo:400: Request processed in 25us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867591:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403162.867609:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050654976 00000100:00100000:3.0:1789403162.867616:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050654976 00000100:00100000:3.0:1789403162.867647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789403162.867654:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3629:x1876325050654976:12345-0@lo:400: 00000100:00100000:3.0:1789403162.867682:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3629:x1876325050654976:12345-0@lo:400: Request processed in 28us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.867688:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789403162.867717:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655872 00000100:00100000:3.0:1789403162.867721:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655872 00000100:00100000:3.0:1789403162.867760:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403162.867764:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403162.867767:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050655872:12345-0@lo:400: 00000100:00100000:2.0:1789403162.867791:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655232 00000100:00100000:3.0:1789403162.867796:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050655872:12345-0@lo:400: Request processed in 30us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403162.867796:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655232 00000100:00100000:3.0:1789403162.867808:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403162.867819:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789403162.867825:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050655232:12345-0@lo:400: 00000100:00080000:3.0:1789403162.867839:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403162.867843:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403162.867846:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403162.867858:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050655232:12345-0@lo:400: Request processed in 34us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403162.867864:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789403162.867880:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2c000 x1876325050655360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403162.867890:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050655360:0@lo:400: 00000100:00100000:2.0:1789403162.867891:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050655232:0@lo:400: 00010000:00080000:3.0:1789403162.867902:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3fb80 x1876325050655872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789403162.867902:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649180 x1876325050655744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403162.867912:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050655872:0@lo:400: 00000100:00100000:2.0:1789403162.867912:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050655744:0@lo:400: 00010000:00080000:2.0:1789403162.867921:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aaed80 x1876325050656256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403162.867928:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050656256:0@lo:400: 00010000:00080000:2.0:1789403162.867938:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2df80 x1876325050655104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403162.867939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403162.867945:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050655104:0@lo:400: 00010000:00080000:2.0:1789403162.867964:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64b480 x1876325050655616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403162.867968:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050656000:0@lo:400: 00000100:00100000:2.0:1789403162.867971:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050655616:0@lo:400: 00010000:00080000:2.0:1789403162.867992:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aac380 x1876325050656128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403162.868000:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050656128:0@lo:400: 00000100:00100000:3.0:1789403162.868004:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403162.868027:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050654976:0@lo:400: 00000100:00100000:3.0:1789403162.868041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050655488 00000100:00100000:3.0:1789403162.868045:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050655488 00000100:00100000:3.0:1789403162.868062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403162.868069:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050655488:12345-0@lo:400: 00000100:00100000:3.0:1789403162.868098:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050655488:12345-0@lo:400: Request processed in 31us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403162.868104:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403162.868408:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656000 00000100:00100000:0.0:1789403162.868412:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656000 00000100:00100000:0.0:1789403162.868445:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403162.868452:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050656000:12345-0@lo:400: 00000100:00100000:2.0:1789403162.868458:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050655488:0@lo:400: 00000100:00100000:0.0:1789403162.868486:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050656000:12345-0@lo:400: Request processed in 34us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403162.868492:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789403162.868495:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aaf800 x1876325050656000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403162.868504:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050656000:0@lo:400: 00000100:00080000:0.0:1789403162.868522:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789403163.122470:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789403163.976519:0:9856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789403164.145552:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789403164.937077:0:9908:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403164.937565:0:9908:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403165.170214:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403165.425637:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050656384:0@lo:13: 00000100:00100000:0.0:1789403165.425721:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403165.425796:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656384 00000100:00100000:0.0:1789403165.425803:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656384 00000100:00100000:0.0:1789403165.425855:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403165.425864:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050656384:12345-0@lo:13: 00002000:00000024:0.0:1789403165.425906:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403165.425947:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050656384:12345-0@lo:13: Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403165.425954:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789403165.425988:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403165.426016:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143383b80 x1876325050656384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403165.426035:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050656384:0@lo:13: 00000100:00100000:2.0:1789403165.430611:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403165.430633:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050656512:0@lo:13: 00000100:00100000:2.0:1789403165.430992:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403165.431046:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656512 00000100:00100000:2.0:1789403165.431053:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656512 00000100:00100000:2.0:1789403165.431105:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403165.431114:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050656512:12345-0@lo:13: 00002000:00000024:2.0:1789403165.431134:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403165.431193:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050656512:12345-0@lo:13: Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403165.431199:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789403165.431220:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403165.431246:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142500a80 x1876325050656512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403165.431274:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050656512:0@lo:13: 00000100:00100000:2.0:1789403165.938359:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403165.938383:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050656640:0@lo:41: 00000100:00100000:2.0:1789403165.938472:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403165.938546:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656640 00000100:00100000:1.0:1789403165.938555:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656640 00000100:00100000:1.0:1789403165.938608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789403165.938617:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050656640:12345-0@lo:41: 00000004:00000024:1.0:1789403165.938647:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789403165.938706:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050656640:12345-0@lo:41: Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403165.938712:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789403165.939083:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050656640:0@lo:41: 00010000:00010000:3.0:1789403166.195625:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789403166.962322:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789403166.962330:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a27b560000 from 39 10000000:01000000:2.0:1789403166.962334:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789403166.962379:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403166.962405:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403166.962416:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403166.962440:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050656768:0@lo:101: 00000100:00100000:2.0:1789403166.962516:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403166.962564:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403166.964549:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656768 00000100:00100000:3.0:1789403166.964563:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656768 00000100:00100000:3.0:1789403166.964623:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789403166.964647:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050656768:12345-0@lo:101: 00010000:00010000:3.0:1789403166.964664:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403166.964680:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760aae expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.964706:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.964717:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.964726:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184600, rc 0) 00000100:00100000:1.0:1789403166.964779:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403166.964796:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050656768:12345-0@lo:101: Request processed in 152us (2279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.964799:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050656896:0@lo:41: 00000100:00100000:3.0:1789403166.964811:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789403166.964851:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.964868:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050656768:0@lo:101: 00010000:00010000:3.0:1789403166.964887:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403166.964893:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050656896 00010000:00010000:3.0:1789403166.964898:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403166.964899:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050656896 00000100:00100000:1.0:1789403166.964966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789403166.964974:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050656896:12345-0@lo:41: 00000100:00100000:3.0:1789403166.964997:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657024:0@lo:501: 00000004:00000024:1.0:1789403166.965004:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789403166.965029:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.965060:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.965061:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050656896:12345-0@lo:41: Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.965071:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403166.965076:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657024 00000100:00100000:3.0:1789403166.965080:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657024 00000100:00100000:3.0:1789403166.965109:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789403166.965118:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050656896:0@lo:41: 00000100:00100000:3.0:1789403166.965119:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050657024:12345-0@lo:501: 00000100:00100000:3.0:1789403166.965265:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050657024:12345-0@lo:501: Request processed in 150us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403166.965272:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789403166.966333:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657024:0@lo:501: 00000100:00100000:1.0:1789403166.966405:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657152:0@lo:503: 00000100:00100000:1.0:1789403166.966456:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403166.966481:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2435040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403166.966563:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657152 00000100:00100000:3.0:1789403166.966570:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657152 00000100:00100000:3.0:1789403166.966624:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789403166.966635:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050657152:12345-0@lo:503: 00000100:00100000:3.0:1789403166.966738:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050657152:12345-0@lo:503: Request processed in 105us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403166.966745:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789403166.966842:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657152:0@lo:503: 00000100:00100000:2.0:1789403166.967221:0:9962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9962:1876325050657280:0@lo:502: 00000100:00100000:2.0:1789403166.967266:0:9962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403166.967292:0:9962:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403166.967321:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657280 00000100:00100000:2.0:1789403166.967325:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657280 00000100:00100000:2.0:1789403166.967352:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789403166.967368:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9962:x1876325050657280:12345-0@lo:502: 00000100:00100000:2.0:1789403166.967503:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9962:x1876325050657280:12345-0@lo:502: Request processed in 137us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403166.967510:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789403166.967689:0:9962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9962:1876325050657280:0@lo:502: 00000100:00100000:0.0:1789403166.967736:0:9962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9962:1876325050657408:0@lo:502: 00000100:00100000:0.0:1789403166.967772:0:9962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403166.967802:0:9962:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.967867:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657408 00000100:00100000:1.0:1789403166.967873:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657408 00000100:00100000:1.0:1789403166.967908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789403166.967916:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9962:x1876325050657408:12345-0@lo:502: 00000100:00100000:1.0:1789403166.968001:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:9962:x1876325050657408:12345-0@lo:502: Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.968008:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789403166.968084:0:9962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9962:1876325050657408:0@lo:502: 00000040:00080000:0.0:1789403166.968103:0:9962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789403166.968291:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789403166.968314:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403166.968323:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.968334:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403166.968344:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789403166.968354:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789403166.968357:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789403166.968381:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.968417:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.968426:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403166.968440:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657536:0@lo:101: 00000100:00100000:1.0:1789403166.968468:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403166.968486:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403166.968627:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657536 00000100:00100000:0.0:1789403166.968632:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657536 00000100:00100000:0.0:1789403166.968661:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789403166.968667:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050657536:12345-0@lo:101: 00010000:00010000:0.0:1789403166.968675:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403166.968686:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760abc expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403166.968707:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403166.968717:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403166.968733:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1400, rc 0) 00000100:00100000:0.0:1789403166.968761:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050657536:12345-0@lo:101: Request processed in 94us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403166.968767:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789403166.968993:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657536:0@lo:101: 00010000:00010000:1.0:1789403166.969007:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.969015:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403166.969060:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657664:0@lo:501: 00000100:00100000:1.0:1789403166.969088:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403166.969115:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403166.969150:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657664 00000100:00100000:0.0:1789403166.969154:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657664 00000100:00100000:0.0:1789403166.969231:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789403166.969240:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050657664:12345-0@lo:501: 00000100:00100000:0.0:1789403166.969338:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050657664:12345-0@lo:501: Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403166.969344:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789403166.969409:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657664:0@lo:501: 00000100:00100000:1.0:1789403166.969433:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657792:0@lo:503: 00000100:00100000:1.0:1789403166.969468:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403166.971843:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403166.972037:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657792 00000100:00100000:3.0:1789403166.972046:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657792 00000100:00100000:3.0:1789403166.972351:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789403166.972361:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050657792:12345-0@lo:503: 00000100:00100000:3.0:1789403166.972726:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050657792:12345-0@lo:503: Request processed in 365us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403166.972734:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789403166.972790:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050657792:0@lo:503: 00000100:00100000:3.0:1789403166.973281:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9963:1876325050657920:0@lo:502: 00000100:00100000:3.0:1789403166.973328:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.973353:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050657920 00000100:00100000:3.0:1789403166.973359:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050657920 00000100:00100000:3.0:1789403166.973380:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789403166.973407:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9963:x1876325050657920:12345-0@lo:502: 00000100:00100000:3.0:1789403166.973653:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9963:x1876325050657920:12345-0@lo:502: Request processed in 265us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403166.973677:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789403166.973730:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403166.973749:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9963:1876325050657920:0@lo:502: 00000020:01000000:3.0:1789403166.973773:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403166.973782:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403166.973784:0:9963:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403166.973790:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403166.973791:0:9963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789403166.973808:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9963:1876325050658048:0@lo:502: 00000100:00100000:3.0:1789403166.973841:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.973867:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403166.973889:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658048 00000100:00100000:3.0:1789403166.973893:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658048 00000100:00100000:3.0:1789403166.973916:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789403166.973922:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9963:x1876325050658048:12345-0@lo:502: 00000100:00100000:3.0:1789403166.974504:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:9963:x1876325050658048:12345-0@lo:502: Request processed in 580us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403166.974511:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789403166.974558:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9963:1876325050658048:0@lo:502: 00000020:01000000:3.0:1789403166.974582:0:9963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403166.974588:0:9963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403166.974590:0:9963:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789403166.974594:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789403166.974650:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789403166.974670:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789403166.974680:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.974703:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403166.974714:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789403166.974717:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a281b11800 from 39 10000000:01000000:3.0:1789403166.974721:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403166.974749:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.974760:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.974775:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403166.974790:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658176:0@lo:101: 00000100:00100000:3.0:1789403166.974820:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.974846:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403166.975225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658176 00000100:00100000:3.0:1789403166.975231:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658176 00000100:00100000:3.0:1789403166.975262:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789403166.975270:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050658176:12345-0@lo:101: 00010000:00010000:3.0:1789403166.975280:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403166.975291:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760aca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.975313:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.975918:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 18 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.975937:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184000, rc 0) 00000100:00100000:2.0:1789403166.976063:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050658176:12345-0@lo:101: Request processed in 792us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403166.976071:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789403166.977109:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658176:0@lo:101: 00010000:00010000:3.0:1789403166.977133:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.977144:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403166.977515:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658304:0@lo:501: 00000100:00100000:2.0:1789403166.977557:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403166.977595:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.977641:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658304 00000100:00100000:1.0:1789403166.977648:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658304 00000100:00100000:1.0:1789403166.977718:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789403166.977728:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050658304:12345-0@lo:501: 00000100:00100000:1.0:1789403166.977862:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050658304:12345-0@lo:501: Request processed in 135us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.977877:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789403166.979069:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658304:0@lo:501: 00000100:00100000:3.0:1789403166.979119:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658432:0@lo:503: 00000100:00100000:3.0:1789403166.979189:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.981677:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403166.982029:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658432 00000100:00100000:2.0:1789403166.982038:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658432 00000100:00100000:2.0:1789403166.982088:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789403166.982096:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050658432:12345-0@lo:503: 00000100:00100000:2.0:1789403166.983838:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050658432:12345-0@lo:503: Request processed in 1736us (4642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403166.983850:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789403166.984333:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658432:0@lo:503: 00000100:00100000:2.0:1789403166.985092:0:9965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9965:1876325050658560:0@lo:502: 00000100:00100000:2.0:1789403166.985148:0:9965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403166.985182:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658560 00000100:00100000:2.0:1789403166.985775:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658560 00000100:00100000:2.0:1789403166.985814:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789403166.985823:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:9965:x1876325050658560:12345-0@lo:502: 00000100:00100000:2.0:1789403166.986044:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:9965:x1876325050658560:12345-0@lo:502: Request processed in 221us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403166.986061:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789403166.986116:0:9965:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403166.986135:0:9965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9965:1876325050658560:0@lo:502: 00000100:00100000:2.0:1789403166.986505:0:9965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9965:1876325050658688:0@lo:502: 00000100:00100000:2.0:1789403166.986543:0:9965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403166.986569:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658688 00000100:00100000:2.0:1789403166.986573:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658688 00000100:00100000:2.0:1789403166.986593:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789403166.986599:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:9965:x1876325050658688:12345-0@lo:502: 00000100:00100000:2.0:1789403166.986661:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:9965:x1876325050658688:12345-0@lo:502: Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403166.986668:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789403166.987105:0:9965:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403166.987120:0:9965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9965:1876325050658688:0@lo:502: 00000040:00080000:2.0:1789403166.987143:0:9965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789403166.987265:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789403166.987287:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403166.987298:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403166.987309:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403166.987320:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789403166.987324:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b11800 from 6 10000000:01000000:0.0:1789403166.987327:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403166.987354:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403166.987362:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403166.987383:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403166.987436:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658816:0@lo:101: 00000100:00100000:0.0:1789403166.987469:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403166.987491:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.987773:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658816 00000100:00100000:1.0:1789403166.987778:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658816 00000100:00100000:1.0:1789403166.987810:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789403166.987819:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050658816:12345-0@lo:101: 00010000:00010000:1.0:1789403166.987829:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403166.987840:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760ad8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.987860:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760ad8 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.992029:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760ad8 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.992047:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27e00, rc 0) 00000100:00100000:1.0:1789403166.992140:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050658816:12345-0@lo:101: Request processed in 4322us (4669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.992148:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789403166.992238:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658816:0@lo:101: 00010000:00010000:1.0:1789403166.992259:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.992284:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403166.992349:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658944:0@lo:256: 00000100:00100000:1.0:1789403166.992385:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403166.992432:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.992448:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050658944 00000100:00100000:1.0:1789403166.992454:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050658944 00000100:00100000:1.0:1789403166.992483:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789403166.992491:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050658944:12345-0@lo:256: 20000000:01000000:1.0:1789403166.992508:0:6493:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403166.992525:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403166.992528:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789403166.992598:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050658944:12345-0@lo:256: Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.992605:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789403166.992638:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050658944:0@lo:256: 10000000:01000000:1.0:1789403166.993249:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403166.993259:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.993269:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403166.993279:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789403166.993282:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1789403166.993286:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789403166.993320:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.993329:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.993337:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403166.993353:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050659072:0@lo:101: 00000100:00100000:1.0:1789403166.993384:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403166.993419:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.993437:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659072 00000100:00100000:1.0:1789403166.993443:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659072 00000100:00100000:1.0:1789403166.993472:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789403166.993481:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050659072:12345-0@lo:101: 00010000:00010000:1.0:1789403166.993490:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403166.993500:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760ae6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.993519:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.993527:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403166.993535:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27200, rc 0) 00000100:00100000:1.0:1789403166.993573:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050659072:12345-0@lo:101: Request processed in 94us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.993579:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789403166.994041:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050659072:0@lo:101: 00010000:00010000:3.0:1789403166.994061:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403166.994073:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403166.994138:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050659200:0@lo:501: 00000100:00100000:3.0:1789403166.994288:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403166.994320:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.994782:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659200 00000100:00100000:1.0:1789403166.994789:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659200 00000100:00100000:1.0:1789403166.994831:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789403166.994838:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050659200:12345-0@lo:501: 00000100:00100000:1.0:1789403166.995375:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050659200:12345-0@lo:501: Request processed in 536us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.995382:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789403166.995458:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050659200:0@lo:501: 00000100:00100000:3.0:1789403166.995513:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050659328:0@lo:503: 00000100:00100000:2.0:1789403166.995788:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403166.995825:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403166.995871:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659328 00000100:00100000:1.0:1789403166.995877:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659328 00000100:00100000:1.0:1789403166.995959:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789403166.995968:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050659328:12345-0@lo:503: 00000100:00100000:1.0:1789403166.996061:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050659328:12345-0@lo:503: Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403166.996067:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789403166.996128:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050659328:0@lo:503: 00000100:00100000:2.0:1789403166.996317:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9966:1876325050659456:0@lo:502: 00000100:00100000:2.0:1789403166.996350:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.005201:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d540 going to sleep for 10 seconds 00000100:00100000:3.0:1789403167.006328:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659456 00000100:00100000:3.0:1789403167.006340:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659456 00000100:00100000:3.0:1789403167.006412:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789403167.006422:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:9966:x1876325050659456:12345-0@lo:502: 00000100:00100000:3.0:1789403167.006576:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:9966:x1876325050659456:12345-0@lo:502: Request processed in 156us (10225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.006583:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789403167.006752:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9966:1876325050659456:0@lo:502: 00000020:01000000:2.0:1789403167.006782:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789403167.006789:0:9966:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789403167.006796:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403167.006802:0:9966:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789403167.006808:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789403167.006811:0:9966:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:2.0:1789403167.006832:0:9966:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789403167.006835:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403167.006849:0:9966:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90a27c364d40) 00000020:00000080:2.0:1789403167.006881:0:9966:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789403167.006887:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789403167.006987:0:9966:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789403167.006993:0:9966:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789403167.007001:0:9966:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b760afb 00010000:00080000:2.0:1789403167.007028:0:9966:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a27c33b800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1789403167.007354:0:9966:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789403167.007492:0:9966:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789403167.007502:0:9966:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789403167.007648:0:9966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403167.008595:0:9966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403167.009063:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789403167.009164:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789403167.018143:0:9968:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403167.018149:0:9968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789403167.018851:0:9966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789403167.018862:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789403167.018911:0:9966:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789403167.018946:0:9966:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b760b02 00000100:00080000:1.0:1789403167.018967:0:9966:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403167.018980:0:9966:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a27c33b800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403167.019016:0:9966:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14251e680 x1876325050659584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403167.019041:0:9966:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789403167.019093:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403167.019097:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403167.019099:0:9966:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789403167.019102:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403167.019106:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403167.019113:0:9966:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789403167.019116:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789403167.019118:0:9966:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789403167.019146:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9966:1876325050659712:0@lo:502: 00000100:00100000:1.0:1789403167.019220:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.019252:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504780 going to sleep for 11 seconds 00000100:00100000:3.0:1789403167.019432:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050659584:0@lo:8: 00000100:00100000:3.0:1789403167.019468:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.019598:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659712 00000100:00100000:3.0:1789403167.019605:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659712 00000100:00100000:3.0:1789403167.019640:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789403167.019649:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:9966:x1876325050659712:12345-0@lo:502: 00000100:00100000:3.0:1789403167.019765:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:9966:x1876325050659712:12345-0@lo:502: Request processed in 116us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.019773:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789403167.019811:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050659840:0@lo:400: 00000100:00100000:3.0:1789403167.019838:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.019857:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050660352:0@lo:400: 00000100:00100000:3.0:1789403167.019874:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.019887:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050660864:0@lo:400: 00000100:00100000:3.0:1789403167.019905:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.019935:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789403167.019941:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050659968:0@lo:400: 00000100:00100000:3.0:1789403167.019982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.019999:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050660480:0@lo:400: 00000100:00100000:3.0:1789403167.020017:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.020031:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050660992:0@lo:400: 00000100:00100000:3.0:1789403167.020048:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.020067:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050660096:0@lo:400: 00000100:00100000:3.0:1789403167.020086:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.020095:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050660608:0@lo:400: 00000100:00100000:3.0:1789403167.020114:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.020138:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789403167.020143:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050660224:0@lo:400: 00000100:00100000:3.0:1789403167.020162:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.020179:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050660736:0@lo:400: 00000100:00100000:3.0:1789403167.020197:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.020224:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659840 00000100:00100000:3.0:1789403167.020229:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659840 00000100:00100000:3.0:1789403167.020250:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660352 00000100:00100000:3.0:1789403167.020253:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660352 00000100:00100000:3.0:1789403167.020275:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660864 00000100:00100000:3.0:1789403167.020278:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660864 00000100:00100000:3.0:1789403167.020289:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660480 00000100:00100000:3.0:1789403167.020292:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660480 00000100:00100000:3.0:1789403167.020302:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660992 00000100:00100000:3.0:1789403167.020304:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660992 00000100:00100000:3.0:1789403167.020314:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660096 00000100:00100000:3.0:1789403167.020316:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660096 00000100:00100000:3.0:1789403167.020328:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403167.020334:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050659840:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020380:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050659840:12345-0@lo:400: Request processed in 46us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020408:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403167.020422:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789403167.020429:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050660352:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020455:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050660352:12345-0@lo:400: Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020461:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789403167.020471:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789403167.020477:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050660864:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020502:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050660864:12345-0@lo:400: Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020507:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789403167.020518:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403167.020523:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050660480:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020549:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050660480:12345-0@lo:400: Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020554:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403167.020563:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403167.020569:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050660992:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020590:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050660992:12345-0@lo:400: Request processed in 22us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020596:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403167.020606:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403167.020611:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050660096:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020654:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050660096:12345-0@lo:400: Request processed in 43us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020661:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403167.020684:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659968 00000100:00100000:3.0:1789403167.020688:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659968 00000100:00100000:3.0:1789403167.020703:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660224 00000100:00100000:3.0:1789403167.020705:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660224 00000100:00100000:3.0:1789403167.020715:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789403167.020720:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050659968:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020747:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050659968:12345-0@lo:400: Request processed in 27us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020753:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789403167.020763:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789403167.020768:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050660224:12345-0@lo:400: 00000100:00100000:3.0:1789403167.020789:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050660224:12345-0@lo:400: Request processed in 21us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.020794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789403167.020814:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403167.020818:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403167.020843:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050660224:0@lo:400: 00010000:00080000:3.0:1789403167.020855:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3fb80 x1876325050660096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.020865:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050660096:0@lo:400: 00000100:00100000:3.0:1789403167.020892:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050659968:0@lo:400: 00010000:00080000:3.0:1789403167.020901:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2df80 x1876325050660480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.020922:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050660480:0@lo:400: 00010000:00080000:3.0:1789403167.020934:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3f800 x1876325050660992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.020942:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050660992:0@lo:400: 00010000:00080000:3.0:1789403167.020962:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143383b80 x1876325050659840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.020971:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050659840:0@lo:400: 00010000:00080000:3.0:1789403167.020981:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2e300 x1876325050660352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.020988:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050660352:0@lo:400: 00010000:00080000:3.0:1789403167.020996:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3d180 x1876325050660864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.021002:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050660864:0@lo:400: 00000100:00100000:1.0:1789403167.021252:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050659584 00000100:00100000:1.0:1789403167.021257:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050659584 00000100:00100000:1.0:1789403167.021283:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660608 00000100:00100000:1.0:1789403167.021286:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660608 00000100:00100000:1.0:1789403167.021311:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050660736 00000100:00100000:1.0:1789403167.021314:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050660736 00000100:00100000:1.0:1789403167.021328:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403167.021334:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050660608:12345-0@lo:400: 00000100:00100000:1.0:1789403167.021379:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050660608:12345-0@lo:400: Request processed in 45us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.021385:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403167.021417:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403167.021422:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050660736:12345-0@lo:400: 00000100:00100000:1.0:1789403167.021449:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050660736:12345-0@lo:400: Request processed in 27us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.021455:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403167.021466:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403167.021470:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050659584:12345-0@lo:8: 00010000:00080000:1.0:1789403167.021494:0:8415:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1789403167.021520:0:8415:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b760b09 00002000:00100000:1.0:1789403167.021532:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90a1421c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789403167.021536:0:8415:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789403167.021546:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789403167.021607:0:8415:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789403167.022231:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789403167.022258:0:8415:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403167.022572:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050659584:12345-0@lo:8: Request processed in 1098us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.022580:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789403167.022601:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789403167.022629:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2c000 x1876325050660736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403167.022642:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050660736:0@lo:400: 00010000:00080000:1.0:1789403167.022654:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2ce00 x1876325050660608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403167.022662:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050660608:0@lo:400: 00000100:00100000:1.0:1789403167.022716:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9966:1876325050659712:0@lo:502: 00000020:01000000:1.0:1789403167.022745:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403167.022752:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403167.022754:0:9966:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789403167.022758:0:9966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1789403167.023422:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1789403167.023446:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789403167.023456:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403167.023468:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403167.023479:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789403167.023482:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a244ea0000 from 39 10000000:01000000:0.0:1789403167.023485:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789403167.023520:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403167.023528:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403167.023537:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403167.023554:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050661120:0@lo:101: 00000100:00100000:0.0:1789403167.023596:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.023638:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.025801:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661120 00000100:00100000:1.0:1789403167.025814:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661120 00000100:00100000:1.0:1789403167.025885:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789403167.025895:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050661120:12345-0@lo:101: 00010000:00010000:1.0:1789403167.025912:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403167.025928:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760b10 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.025980:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.025991:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.026001:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27800, rc 0) 00000100:00100000:1.0:1789403167.026077:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050661120:12345-0@lo:101: Request processed in 183us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.026084:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789403167.027894:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050661120:0@lo:101: 00010000:00010000:1.0:1789403167.027922:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.027933:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403167.028018:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050661248:0@lo:501: 00000100:00100000:1.0:1789403167.028066:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.028099:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504540 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.028115:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661248 00000100:00100000:1.0:1789403167.028120:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661248 00000100:00100000:1.0:1789403167.028153:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789403167.028160:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050661248:12345-0@lo:501: 00000100:00100000:1.0:1789403167.028265:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050661248:12345-0@lo:501: Request processed in 105us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.028271:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789403167.028309:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050661248:0@lo:501: 00000100:00100000:1.0:1789403167.028334:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050661376:0@lo:503: 00000100:00100000:1.0:1789403167.028366:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.028377:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504540 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.028404:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661376 00000100:00100000:1.0:1789403167.028407:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661376 00000100:00100000:1.0:1789403167.028424:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789403167.028429:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050661376:12345-0@lo:503: 00000100:00100000:1.0:1789403167.028492:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050661376:12345-0@lo:503: Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.028498:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789403167.028529:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050661376:0@lo:503: 00010000:00080000:3.0:1789403167.028863:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251e680 x1876325050659584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.028883:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403167.028891:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789403167.028899:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789403167.028903:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789403167.028906:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27c33b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789403167.028926:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789403167.028932:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050659584:0@lo:8: 00000100:00100000:1.0:1789403167.029099:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050661504:0@lo:700: 00000100:00100000:1.0:1789403167.029127:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.029151:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403167.029189:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661504 00000100:00100000:3.0:1789403167.029193:0:8423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661504 00000100:00100000:3.0:1789403167.029234:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403167.029241:0:8423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9970:x1876325050661504:12345-0@lo:700: 00000100:00100000:3.0:1789403167.029266:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8423:1876325050661632:0@lo:700: 00000100:00100000:3.0:1789403167.029291:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.029304:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403167.029321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661632 00000100:00100000:3.0:1789403167.029323:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661632 00000100:00100000:3.0:1789403167.029343:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403167.029348:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8423:x1876325050661632:12345-0@lo:700: 00000100:00080000:1.0:1789403167.029541:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789403167.029610:0:9968:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789403167.029656:0:9968:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 213028266803ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789403167.029783:0:9968:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 40000000:02000000:2.0:1789403167.039896:0:6506:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1789403167.047492:0:9971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9971:1876325050661760:0@lo:502: 00000100:00100000:0.0:1789403167.047575:0:9971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.047615:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661760 00000100:00100000:0.0:1789403167.047622:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661760 00000100:00100000:0.0:1789403167.047663:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789403167.049786:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:9971:x1876325050661760:12345-0@lo:502: 00000100:00100000:0.0:1789403167.049992:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:9971:x1876325050661760:12345-0@lo:502: Request processed in 2319us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403167.050000:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789403167.050074:0:9971:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403167.050099:0:9971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9971:1876325050661760:0@lo:502: 00000100:00100000:0.0:1789403167.050158:0:9971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9971:1876325050661888:0@lo:502: 00000100:00100000:0.0:1789403167.050194:0:9971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.050219:0:9971:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c300 going to sleep for 11 seconds 00000004:00080000:2.0:1789403167.050882:0:7431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789403167.050960:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8423:x1876325050661632:12345-0@lo:700: Request processed in 21600us (21657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.050970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789403167.051893:0:8423:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3d180 x1876325050661632/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403167.051909:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8423:1876325050661632:0@lo:700: 40000000:02000000:0.0:1789403167.051921:0:8423:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1789403167.052700:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050661888 00000100:00100000:1.0:1789403167.052709:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050661888 00000100:00100000:1.0:1789403167.052753:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789403167.052762:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:9971:x1876325050661888:12345-0@lo:502: 00000100:00100000:1.0:1789403167.052902:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:9971:x1876325050661888:12345-0@lo:502: Request processed in 141us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.052909:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000001:00100000:2.0:1789403167.070853:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789403167.076052:0:8423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9970:x1876325050661504:12345-0@lo:700: Request processed in 46800us (46912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403167.076066:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403167.076149:0:9971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9971:1876325050661888:0@lo:502: 00000040:00080000:0.0:1789403167.076193:0:9971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789403167.078504:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789403167.078558:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403167.078569:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403167.078581:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403167.078592:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789403167.078595:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a244ea0000 from 6 10000000:01000000:0.0:1789403167.078598:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403167.078634:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403167.078642:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403167.078653:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403167.078675:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662016:0@lo:101: 00000100:00100000:0.0:1789403167.078740:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.078788:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403167.078836:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662016 00000100:00100000:2.0:1789403167.078850:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662016 00000100:00100000:2.0:1789403167.078902:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789403167.078911:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050662016:12345-0@lo:101: 00010000:00010000:2.0:1789403167.078922:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403167.078934:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946200/0x5fb08b1e5b760b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760b1e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.078968:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946200/0x5fb08b1e5b760b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b1e expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.078978:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946200/0x5fb08b1e5b760b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b1e expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.078985:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946200, rc 0) 00000100:00100000:2.0:1789403167.079024:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050662016:12345-0@lo:101: Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.079031:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789403167.079078:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662016:0@lo:101: 00010000:00010000:2.0:1789403167.079091:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079100:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403167.079148:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662144:0@lo:256: 00000100:00100000:2.0:1789403167.079177:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.079191:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403167.079327:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662144 00000100:00100000:0.0:1789403167.079332:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662144 00000100:00100000:0.0:1789403167.079363:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789403167.079370:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050662144:12345-0@lo:256: 20000000:01000000:0.0:1789403167.079383:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789403167.079428:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789403167.079431:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789403167.079506:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050662144:12345-0@lo:256: Request processed in 136us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403167.079519:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789403167.079592:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662144:0@lo:256: 10000000:01000000:2.0:1789403167.079647:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789403167.079654:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079662:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403167.079669:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789403167.079671:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789403167.079674:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789403167.079690:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079696:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079704:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403167.079715:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662272:0@lo:101: 00000100:00100000:2.0:1789403167.079740:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.079767:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403167.079779:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662272 00000100:00100000:2.0:1789403167.079783:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662272 00000100:00100000:2.0:1789403167.079800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789403167.079806:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050662272:12345-0@lo:101: 00010000:00010000:2.0:1789403167.079813:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403167.079822:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760b2c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079846:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079854:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079860:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946800, rc 0) 00000100:00100000:2.0:1789403167.079902:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050662272:12345-0@lo:101: Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.079907:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789403167.079935:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662272:0@lo:101: 00010000:00010000:2.0:1789403167.079945:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403167.079962:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403167.080016:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662400:0@lo:501: 00000100:00100000:2.0:1789403167.080041:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.080054:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403167.080065:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662400 00000100:00100000:2.0:1789403167.080068:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662400 00000100:00100000:2.0:1789403167.080085:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789403167.080090:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050662400:12345-0@lo:501: 00000100:00100000:2.0:1789403167.080205:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050662400:12345-0@lo:501: Request processed in 113us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.080210:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789403167.080247:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662400:0@lo:501: 00000100:00100000:2.0:1789403167.080272:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662528:0@lo:503: 00000100:00100000:2.0:1789403167.080311:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.080323:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403167.080334:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662528 00000100:00100000:2.0:1789403167.080337:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662528 00000100:00100000:2.0:1789403167.080353:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789403167.080358:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050662528:12345-0@lo:503: 00000100:00100000:2.0:1789403167.080457:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050662528:12345-0@lo:503: Request processed in 98us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.080464:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789403167.080504:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050662528:0@lo:503: 00010000:00080000:1.0:1789403167.080626:0:9970:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251c700 x1876325050661504/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403167.080637:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050661504:0@lo:700: 00000100:00100000:2.0:1789403167.083550:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9977:1876325050662656:0@lo:502: 00000100:00100000:2.0:1789403167.083631:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.083741:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403167.089046:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662656 00000100:00100000:0.0:1789403167.089061:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662656 00000100:00100000:0.0:1789403167.089130:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789403167.089141:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:9977:x1876325050662656:12345-0@lo:502: 00000100:00100000:0.0:1789403167.089333:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:9977:x1876325050662656:12345-0@lo:502: Request processed in 194us (5702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403167.089340:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789403167.089574:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9977:1876325050662656:0@lo:502: 00000020:01000000:2.0:1789403167.089611:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789403167.089619:0:9977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789403167.089625:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403167.089627:0:9977:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789403167.089632:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789403167.089636:0:9977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:2.0:1789403167.089659:0:9977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789403167.089662:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403167.089692:0:9977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a1425d3380) 00000020:00000080:2.0:1789403167.089717:0:9977:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789403167.089730:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789403167.089827:0:9977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789403167.089833:0:9977:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789403167.089840:0:9977:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b760b41 00010000:00080000:2.0:1789403167.089865:0:9977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1435c5800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1789403167.090106:0:9977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789403167.090239:0:9977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789403167.090249:0:9977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789403167.090457:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403167.090574:0:9977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403167.090707:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789403167.090791:0:9977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789403167.091538:0:9978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403167.091544:0:9978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789403167.094055:0:9977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403167.094070:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789403167.094112:0:9977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789403167.094140:0:9977:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b760b48 00000100:00080000:1.0:1789403167.094151:0:9977:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403167.094163:0:9977:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a1435c5800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403167.094198:0:9977:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14251c700 x1876325050662784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403167.094231:0:9977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789403167.094317:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403167.094321:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403167.094323:0:9977:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789403167.094326:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403167.094330:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403167.094332:0:9977:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789403167.094335:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789403167.094337:0:9977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789403167.094363:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9977:1876325050662912:0@lo:502: 00000100:00100000:1.0:1789403167.094466:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.094501:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662912 00000100:00100000:1.0:1789403167.094508:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662912 00000100:00100000:1.0:1789403167.094543:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789403167.094551:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:9977:x1876325050662912:12345-0@lo:502: 00000100:00100000:1.0:1789403167.094657:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:9977:x1876325050662912:12345-0@lo:502: Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.094665:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789403167.094713:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.094731:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:9977:1876325050662912:0@lo:502: 00000020:01000000:1.0:1789403167.094760:0:9977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403167.094763:0:9977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403167.094765:0:9977:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789403167.094768:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1789403167.094815:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1789403167.094835:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789403167.094845:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.094856:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403167.094866:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789403167.094869:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a245c9b380 from 1 10000000:01000000:1.0:1789403167.094873:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789403167.094895:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.094903:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.094912:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403167.094926:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050663040:0@lo:101: 00000100:00100000:1.0:1789403167.094965:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.094978:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.094991:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663040 00000100:00100000:1.0:1789403167.094995:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663040 00000100:00100000:1.0:1789403167.095015:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789403167.095028:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050663040:12345-0@lo:101: 00010000:00010000:1.0:1789403167.095037:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403167.095048:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760b4f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.095068:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.095078:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.095087:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241515e00, rc 0) 00000100:00100000:1.0:1789403167.095113:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050663040:12345-0@lo:101: Request processed in 86us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.095119:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789403167.095150:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050663040:0@lo:101: 00010000:00010000:1.0:1789403167.095162:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.095172:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403167.095212:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050663168:0@lo:501: 00000100:00100000:1.0:1789403167.095234:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.095246:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.095256:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663168 00000100:00100000:1.0:1789403167.095259:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663168 00000100:00100000:1.0:1789403167.095278:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789403167.095283:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050663168:12345-0@lo:501: 00000100:00100000:1.0:1789403167.095351:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050663168:12345-0@lo:501: Request processed in 67us (115us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403167.095358:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789403167.095385:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050663168:0@lo:501: 10000000:01000000:1.0:1789403167.095427:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789403167.095433:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403167.095440:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403167.095664:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050662784:0@lo:8: 00000100:00100000:2.0:1789403167.095701:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.095776:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050662784 00000100:00100000:0.0:1789403167.095782:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050662784 00000100:00100000:0.0:1789403167.095815:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403167.095821:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3625:x1876325050662784:12345-0@lo:8: 00010000:00080000:0.0:1789403167.095848:0:8417:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1789403167.095875:0:8417:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b760b5d 00002000:00100000:0.0:1789403167.095890:0:8417:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a143388000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789403167.095894:0:8417:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789403167.095897:0:8417:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789403167.095990:0:8417:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789403167.096016:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a14338c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403167.096067:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050662784:12345-0@lo:8: Request processed in 245us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403167.096074:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789403167.096108:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251c700 x1876325050662784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403167.096118:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403167.096125:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789403167.096141:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789403167.096146:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789403167.096149:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1435c5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789403167.096159:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789403167.096164:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050662784:0@lo:8: 00000004:00080000:2.0:1789403167.096222:0:9978:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789403167.096275:0:9978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 213094885754ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789403167.096281:0:9978:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789403167.102812:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789403167.108423:0:9970:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789403167.108458:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050663424:0@lo:7: 00000100:00100000:1.0:1789403167.108520:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.108541:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663424 00000100:00100000:1.0:1789403167.108547:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484f7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403167.108549:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663424 00000100:00100000:0.0:1789403167.108598:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403167.108608:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9970:x1876325050663424:12345-0@lo:7: 00000100:00100000:3.0:1789403167.108616:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050663296:0@lo:13: 00000100:00100000:3.0:1789403167.108646:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.108709:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663296 00000100:00100000:3.0:1789403167.108713:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663296 00000100:00100000:3.0:1789403167.108739:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403167.108745:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1876325050663296:12345-0@lo:13: 00002000:00000024:3.0:1789403167.108763:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789403167.108808:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1876325050663296:12345-0@lo:13: Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.108815:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789403167.108852:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251fb80 x1876325050663296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.108870:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050663296:0@lo:13: 00000100:00100000:3.0:1789403167.110465:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403167.110484:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050663552:0@lo:13: 00000100:00100000:3.0:1789403167.110544:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.110583:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663552 00000100:00100000:3.0:1789403167.110590:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663552 00000100:00100000:3.0:1789403167.110634:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403167.110641:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050663552:12345-0@lo:13: 00002000:00000024:3.0:1789403167.110670:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789403167.110709:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050663552:12345-0@lo:13: Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.110716:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789403167.110752:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3e300 x1876325050663552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.110768:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050663552:0@lo:13: 00000004:00080000:3.0:1789403167.110785:0:9979:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789403167.110802:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050663680:0@lo:7: 00000100:00100000:3.0:1789403167.110827:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.110849:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663680 00000100:00100000:3.0:1789403167.110853:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663680 00000100:00100000:3.0:1789403167.110887:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403167.110894:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9979:x1876325050663680:12345-0@lo:7: 00000100:00100000:3.0:1789403167.110936:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db180 going to sleep for 11 seconds 00000100:00080000:1.0:1789403167.111000:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789403167.118383:0:8417:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789403167.118408:0:8417:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789403167.118508:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9979:x1876325050663680:12345-0@lo:7: Request processed in 7609us (7675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403167.118517:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789403167.118674:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3e300 x1876325050663680/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403167.118690:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050663680:0@lo:7: 00000004:00080000:0.0:1789403167.118705:0:9979:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789403167.118741:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050663808:0@lo:5: 00000100:00100000:0.0:1789403167.118772:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.118798:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c480 going to sleep for 11 seconds 00002000:00080000:1.0:1789403167.119280:0:8563:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789403167.119286:0:8563:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789403167.119339:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9970:x1876325050663424:12345-0@lo:7: Request processed in 10732us (10818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.119347:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403167.119367:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663808 00000100:00100000:1.0:1789403167.119373:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663808 00000100:00100000:1.0:1789403167.119439:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403167.119448:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9979:x1876325050663808:12345-0@lo:5: 00002000:00080000:1.0:1789403167.119472:0:8416:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789403167.119476:0:8416:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1789403167.119554:0:9970:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251ea00 x1876325050663424/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403167.119566:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050663424:0@lo:7: 00000004:00080000:2.0:1789403167.119575:0:9970:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789403167.119594:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050663936:0@lo:5: 00000100:00100000:2.0:1789403167.119618:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.119633:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.121947:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050663936 00000100:00100000:1.0:1789403167.121969:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050663936 00000100:00100000:1.0:1789403167.122007:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403167.122016:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9970:x1876325050663936:12345-0@lo:5: 00002000:00080000:1.0:1789403167.122043:0:8563:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789403167.122113:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9970:x1876325050663936:12345-0@lo:5: Request processed in 98us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403167.122120:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789403167.122155:0:9970:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142503100 x1876325050663936/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403167.122169:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050663936:0@lo:5: 00000004:00080000:1.0:1789403167.122181:0:9970:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789403167.122217:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050664064:0@lo:5: 00000100:00100000:1.0:1789403167.122246:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403167.122260:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484f73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.122273:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664064 00000100:00100000:1.0:1789403167.122277:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664064 00000100:00100000:1.0:1789403167.122292:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403167.122298:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9970:x1876325050664064:12345-0@lo:5: 00002000:00080000:1.0:1789403167.122320:0:8563:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1789403167.125467:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9970:x1876325050664064:12345-0@lo:5: Request processed in 3163us (3214us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789403167.125480:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789403167.125580:0:9970:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251ea00 x1876325050664064/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403167.125597:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9970:1876325050664064:0@lo:5: 00000004:00080000:0.0:1789403167.125610:0:9970:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789403167.125647:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9970:1876325050664192:0@lo:900: 00000100:00100000:0.0:1789403167.125692:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403167.125718:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403167.130610:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664192 00000100:00100000:2.0:1789403167.130626:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664192 00000100:00100000:2.0:1789403167.130808:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403167.130827:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9970:x1876325050664192:12345-0@lo:900: 00000100:00100000:2.0:1789403167.130956:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9970:x1876325050664192:12345-0@lo:900: Request processed in 124us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.130964:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789403167.131018:0:9970:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7a680 x1876325050664192/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403167.131031:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9970:1876325050664192:0@lo:900: 00000001:00080000:3.0:1789403167.134623:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789403167.134638:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789403167.134670:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789403167.134999:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9979:x1876325050663808:12345-0@lo:5: Request processed in 15547us (16220us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789403167.135010:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789403167.135260:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79880 x1876325050663808/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403167.135273:0:9979:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789403167.135279:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050663808:0@lo:5: 00000004:00080000:2.0:1789403167.135293:0:9979:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789403167.135335:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050664320:0@lo:700: 00000100:00100000:2.0:1789403167.135367:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403167.135423:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664320 00000100:00100000:2.0:1789403167.135429:0:8424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664320 00000100:00100000:2.0:1789403167.135473:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403167.135481:0:8424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9979:x1876325050664320:12345-0@lo:700: 00000100:00100000:2.0:1789403167.135602:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00000 going to sleep for 11 seconds 00000100:00100000:2.0:1789403167.150433:0:8424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9979:x1876325050664320:12345-0@lo:700: Request processed in 14943us (15055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403167.150448:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789403167.150545:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142501180 x1876325050664320/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403167.150571:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050664320:0@lo:700: 00000004:02000040:0.0:1789403167.158202:0:9979:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1789403167.171136:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050664448:0@lo:5: 00000100:00100000:3.0:1789403167.171202:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403167.171254:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db180 going to sleep for 11 seconds 00000100:00100000:1.0:1789403167.171352:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664448 00000100:00100000:1.0:1789403167.171364:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664448 00000100:00100000:1.0:1789403167.172138:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403167.172152:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9979:x1876325050664448:12345-0@lo:5: 00002000:00080000:1.0:1789403167.187350:0:8415:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789403167.187371:0:8415:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1789403167.190117:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9979:x1876325050664448:12345-0@lo:5: Request processed in 17962us (18906us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789403167.190129:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789403167.190212:0:9979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3f100 x1876325050664448/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403167.190230:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9979:1876325050664448:0@lo:5: 00000004:00080000:3.0:1789403167.190244:0:9979:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1789403167.220414:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403168.016303:0:10020:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403168.016833:0:10020:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403168.242604:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403168.859205:0:10068:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403168.859217:0:10068:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789403169.266948:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403169.440116:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403169.440214:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038030976 00000100:00100000:2.0:1789403169.440225:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038030976 00000100:00100000:2.0:1789403169.440274:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:2.0:1789403169.440283:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2386:x1876325038030976:12345-192.168.203.43@tcp:250: 00010000:00080000:2.0:1789403169.440312:0:6492:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 166878b2-2dd8-4b83-a3c7-759691277065@192.168.203.43@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1789403169.440343:0:6492:0:(genops.c:1384:class_connect()) connect: client 166878b2-2dd8-4b83-a3c7-759691277065, cookie 0x5fb08b1e5b760b64 00000100:00080000:2.0:1789403169.440549:0:6492:0:(import.c:65:import_set_state_nolock()) ffff90a1435c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403169.440629:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+5:2386:x1876325038030976:12345-192.168.203.43@tcp:250: Request processed in 345us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.440637:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:0.0:1789403169.451979:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.454772:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031104 00000100:00100000:1.0:1789403169.454789:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031104 00000100:00100000:1.0:1789403169.454868:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:1.0:1789403169.454879:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+5:6148:x1876325038031104:12345-192.168.203.43@tcp:101: 00010000:00010000:1.0:1789403169.454895:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403169.455574:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1285bd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.455608:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 6 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.455620:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 6 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.455629:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241514000, rc 0) 00000100:00100000:1.0:1789403169.455827:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+6:6148:x1876325038031104:12345-192.168.203.43@tcp:101: Request processed in 950us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403169.455835:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:0.0:1789403169.461041:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.464313:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031232 00000100:00100000:1.0:1789403169.464329:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031232 00000100:00100000:1.0:1789403169.464487:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:1.0:1789403169.464499:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+6:6148:x1876325038031232:12345-192.168.203.43@tcp:501: 00000100:00100000:1.0:1789403169.464770:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+6:6148:x1876325038031232:12345-192.168.203.43@tcp:501: Request processed in 273us (3737us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403169.464779:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:0.0:1789403169.469476:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.469674:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031360 00000100:00100000:1.0:1789403169.469686:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031360 00000100:00100000:1.0:1789403169.469794:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:1.0:1789403169.469804:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+6:6148:x1876325038031360:12345-192.168.203.43@tcp:101: 00010000:00010000:1.0:1789403169.469822:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403169.469842:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1285c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.469882:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.469900:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.469909:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241515600, rc 0) 00000100:00100000:1.0:1789403169.469986:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+7:6148:x1876325038031360:12345-192.168.203.43@tcp:101: Request processed in 183us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403169.469992:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:0.0:1789403169.481362:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403169.481498:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031488 00000100:00100000:3.0:1789403169.481509:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031488 00000100:00100000:3.0:1789403169.481555:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:3.0:1789403169.481565:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+7:6148:x1876325038031488:12345-192.168.203.43@tcp:501: 00000100:00100000:3.0:1789403169.481740:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+8:6148:x1876325038031488:12345-192.168.203.43@tcp:501: Request processed in 176us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403169.481747:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:0.0:1789403169.489856:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403169.489975:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031616 00000100:00100000:2.0:1789403169.489986:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031616 00000100:00100000:2.0:1789403169.490086:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:2.0:1789403169.490096:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+8:6148:x1876325038031616:12345-192.168.203.43@tcp:503: 00000100:00100000:2.0:1789403169.490250:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+8:6148:x1876325038031616:12345-192.168.203.43@tcp:503: Request processed in 155us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.490257:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:0.0:1789403169.497379:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.497609:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031744 00000100:00100000:1.0:1789403169.497620:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031744 00000100:00100000:1.0:1789403169.497684:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:1.0:1789403169.497694:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+8:6167:x1876325038031744:12345-192.168.203.43@tcp:502: 00000100:00100000:1.0:1789403169.497863:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+8:6167:x1876325038031744:12345-192.168.203.43@tcp:502: Request processed in 169us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403169.497881:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:0.0:1789403169.558826:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403169.558911:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038031872 00000100:00100000:3.0:1789403169.558921:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038031872 00000100:00100000:2.0:1789403169.560446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:2.0:1789403169.560476:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+8:6167:x1876325038031872:12345-192.168.203.43@tcp:502: 00000100:00100000:2.0:1789403169.561919:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+8:6167:x1876325038031872:12345-192.168.203.43@tcp:502: Request processed in 1454us (3096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.561943:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:0.0:1789403169.575476:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403169.575569:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032000 00000100:00100000:2.0:1789403169.575580:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032000 00000100:00100000:2.0:1789403169.575787:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:2.0:1789403169.575797:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+8:6148:x1876325038032000:12345-192.168.203.43@tcp:101: 00010000:00010000:2.0:1789403169.575813:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403169.575830:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947400/0x5fb08b1e5b760b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1285f5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403169.575854:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947400/0x5fb08b1e5b760b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285f5 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403169.575864:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947400/0x5fb08b1e5b760b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285f5 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403169.575873:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947400, rc 0) 00000100:00100000:2.0:1789403169.576052:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+9:6148:x1876325038032000:12345-192.168.203.43@tcp:101: Request processed in 255us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.576059:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:0.0:1789403169.584763:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403169.584857:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032128 00000100:00100000:2.0:1789403169.584867:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032128 00000100:00100000:2.0:1789403169.584937:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:2.0:1789403169.584948:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+9:6148:x1876325038032128:12345-192.168.203.43@tcp:256: 20000000:01000000:2.0:1789403169.584973:0:6495:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789403169.584998:0:6495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789403169.585002:0:6495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789403169.585005:0:6495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789403169.585008:0:6495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789403169.585010:0:6495:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789403169.589850:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+9:6148:x1876325038032128:12345-192.168.203.43@tcp:256: Request processed in 4893us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.589879:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:0.0:1789403169.602483:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.602572:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032256 00000100:00100000:1.0:1789403169.602582:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032256 00000100:00100000:1.0:1789403169.602642:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:1.0:1789403169.602663:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+9:6148:x1876325038032256:12345-192.168.203.43@tcp:101: 00010000:00010000:1.0:1789403169.602680:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403169.602721:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1285fc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.602752:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.602763:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403169.602772:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04e00, rc 0) 00000100:00100000:1.0:1789403169.602830:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6148:x1876325038032256:12345-192.168.203.43@tcp:101: Request processed in 169us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403169.602837:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:0.0:1789403169.604924:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403169.605016:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032384 00000100:00100000:2.0:1789403169.605025:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032384 00000100:00100000:2.0:1789403169.605076:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:2.0:1789403169.605086:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6148:x1876325038032384:12345-192.168.203.43@tcp:501: 00000100:00100000:2.0:1789403169.605250:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6148:x1876325038032384:12345-192.168.203.43@tcp:501: Request processed in 165us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.605257:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:0.0:1789403169.607103:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403169.607283:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032512 00000100:00100000:2.0:1789403169.607293:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032512 00000100:00100000:2.0:1789403169.607347:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:2.0:1789403169.607358:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:6148:x1876325038032512:12345-192.168.203.43@tcp:503: 00000100:00100000:2.0:1789403169.607569:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:6148:x1876325038032512:12345-192.168.203.43@tcp:503: Request processed in 212us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403169.607577:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:0.0:1789403169.616048:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.616628:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032640 00000100:00100000:1.0:1789403169.616647:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032640 00000100:00100000:1.0:1789403169.616705:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1789403169.616714:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6172:x1876325038032640:12345-192.168.203.43@tcp:502: 00000100:00100000:1.0:1789403169.617136:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6172:x1876325038032640:12345-192.168.203.43@tcp:502: Request processed in 421us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403169.617146:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1789403169.624350:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403169.624495:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032768 00000100:00100000:0.0:1789403169.624505:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032768 00000100:00100000:0.0:1789403169.624607:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:0.0:1789403169.624619:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6172:x1876325038032768:12345-192.168.203.43@tcp:502: 00000100:00100000:0.0:1789403169.624788:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6172:x1876325038032768:12345-192.168.203.43@tcp:502: Request processed in 170us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403169.624796:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:1.0:1789403169.631454:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403169.631483:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403169.631550:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038032896 00000100:00100000:3.0:1789403169.631560:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038032896 00000100:00100000:3.0:1789403169.631600:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033152 00000100:00100000:3.0:1789403169.631603:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033152 00000100:00100000:3.0:1789403169.631623:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403169.631631:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876325038032896:12345-192.168.203.43@tcp:38: 00010000:00080000:3.0:1789403169.631670:0:6499:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789403169.631720:0:6499:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b760b87 00000004:00100000:3.0:1789403169.631743:0:6499:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789403169.631989:0:6499:0:(import.c:65:import_set_state_nolock()) ffff90a1427a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403169.632061:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038032896:12345-192.168.203.43@tcp:38: Request processed in 428us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403169.632069:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403169.632086:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1789403169.632091:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876325038033152:12345-192.168.203.43@tcp:38: 00010000:00080000:3.0:1789403169.632106:0:6499:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789403169.632253:0:6499:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b760b8e 00000004:00100000:3.0:1789403169.632267:0:6499:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789403169.632452:0:6499:0:(import.c:65:import_set_state_nolock()) ffff90a1427a2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403169.632478:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038033152:12345-192.168.203.43@tcp:38: Request processed in 386us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403169.632485:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00010000:00010000:3.0:1789403170.291977:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403170.546461:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403170.554961:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050664704:0@lo:13: 00000100:00100000:2.0:1789403170.555142:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403170.555258:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050664576:0@lo:13: 00000100:00100000:2.0:1789403170.555285:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403170.555676:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664704 00000100:00100000:3.0:1789403170.555685:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664704 00000100:00100000:3.0:1789403170.555782:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664576 00000100:00100000:3.0:1789403170.555786:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664576 00000100:00080000:0.0:1789403170.555951:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403170.556016:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403170.556029:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050664704:12345-0@lo:13: 00002000:00000024:1.0:1789403170.556062:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403170.556132:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050664704:12345-0@lo:13: Request processed in 106us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403170.556138:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789403170.556342:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3e300 x1876325050664704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403170.556363:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050664704:0@lo:13: 00000100:00100000:3.0:1789403170.556562:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403170.556570:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050664576:12345-0@lo:13: 00002000:00000024:3.0:1789403170.556581:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403170.556627:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050664576:12345-0@lo:13: Request processed in 58us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403170.556634:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789403170.556822:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142502a00 x1876325050664576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403170.556836:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050664576:0@lo:13: 00000100:00100000:1.0:1789403170.636974:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403170.637008:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403170.637087:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403170.637165:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033408 00000100:00100000:3.0:1789403170.637175:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033408 00000100:00100000:3.0:1789403170.637237:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033280 00000100:00100000:3.0:1789403170.637264:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033280 00000100:00100000:3.0:1789403170.637282:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033024 00000100:00100000:3.0:1789403170.637284:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033024 00000100:00100000:3.0:1789403170.637301:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1789403170.637310:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:6148:x1876325038033408:12345-192.168.203.43@tcp:41: 00000004:00000024:3.0:1789403170.637347:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789403170.637456:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:6148:x1876325038033408:12345-192.168.203.43@tcp:41: Request processed in 146us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403170.637465:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1789403170.637474:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1789403170.637487:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1789403170.637491:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038033280:12345-192.168.203.43@tcp:41: 00000100:00100000:3.0:1789403170.637500:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038033024:12345-192.168.203.43@tcp:41: 00000004:00000024:3.0:1789403170.637514:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:0.0:1789403170.637516:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403170.637537:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038033024:12345-192.168.203.43@tcp:41: Request processed in 40us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403170.637544:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1789403170.637555:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038033280:12345-192.168.203.43@tcp:41: Request processed in 70us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403170.637563:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00080000:1.0:1789403170.638017:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403170.638022:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403170.643580:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403170.643682:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033536 00000100:00100000:0.0:1789403170.643692:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033536 00000100:00100000:0.0:1789403170.643748:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1789403170.643758:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6148:x1876325038033536:12345-192.168.203.43@tcp:40: 00000100:00100000:0.0:1789403170.643895:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6148:x1876325038033536:12345-192.168.203.43@tcp:40: Request processed in 138us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403170.643903:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1789403170.661454:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403170.661499:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403170.661548:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403170.661593:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403170.661627:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034048 00000100:00100000:1.0:1789403170.661636:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034048 00000100:00100000:1.0:1789403170.661682:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:1.0:1789403170.661691:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038034048:12345-192.168.203.43@tcp:400: 00000100:00100000:1.0:1789403170.661763:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038034048:12345-192.168.203.43@tcp:400: Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403170.661771:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:3.0:1789403170.661783:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033664 00000100:00100000:3.0:1789403170.661791:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033664 00000100:00100000:3.0:1789403170.661818:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033792 00000100:00100000:3.0:1789403170.661822:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033792 00000100:00100000:3.0:1789403170.661838:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1789403170.661844:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1876325038033664:12345-192.168.203.43@tcp:8: 00010000:00080000:3.0:1789403170.661873:0:8416:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1789403170.661905:0:8416:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b760b95 00002000:00100000:3.0:1789403170.661918:0:8416:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4/ffff90a1427a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1789403170.661948:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1789403170.661962:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876325038033792:12345-192.168.203.43@tcp:8: 00010000:00080000:1.0:1789403170.661981:0:8417:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1789403170.661997:0:8417:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b760b9c 00002000:00100000:1.0:1789403170.662003:0:8417:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4/ffff90a27c339000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789403170.662020:0:8417:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789403170.662189:0:8417:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789403170.662215:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a141a3e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403170.662249:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038033792:12345-192.168.203.43@tcp:8: Request processed in 287us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403170.662257:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00002000:00100000:3.0:1789403170.662517:0:8416:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789403170.662528:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038033920 00000100:00100000:2.0:1789403170.662534:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038033920 00000100:00100000:2.0:1789403170.662581:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1789403170.662592:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6148:x1876325038033920:12345-192.168.203.43@tcp:900: 00000100:00100000:2.0:1789403170.662641:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6148:x1876325038033920:12345-192.168.203.43@tcp:900: Request processed in 52us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403170.662649:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00002000:00080000:3.0:1789403170.662710:0:8416:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789403170.662731:0:8416:0:(import.c:65:import_set_state_nolock()) ffff90a1427a0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403170.662778:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038033664:12345-192.168.203.43@tcp:8: Request processed in 933us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403170.662785:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403170.666784:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403170.666894:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034176 00000100:00100000:0.0:1789403170.666905:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034176 00000100:00100000:0.0:1789403170.666970:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1789403170.666980:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6148:x1876325038034176:12345-192.168.203.43@tcp:33: 00000004:00080000:0.0:1789403170.682315:0:6502:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15246us 00000004:00200000:1.0:1789403170.711096:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789403170.711209:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6148:x1876325038034176:12345-192.168.203.43@tcp:33: Request processed in 44225us (44428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403170.711223:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1789403171.005771:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403171.005876:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034304 00000100:00100000:0.0:1789403171.005887:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034304 00000100:00100000:0.0:1789403171.005954:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1789403171.005965:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6190:x1876325038034304:12345-192.168.203.43@tcp:101: 00010000:00010000:0.0:1789403171.005984:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403171.006045:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0000/0x5fb08b1e5b760ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12862d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403171.006132:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b760baa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403171.006145:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b760baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403171.006162:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b760baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403171.006205:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403171.006209:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403171.006226:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b760baa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403171.006253:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0000/0x5fb08b1e5b760ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12862d expref: 8 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403171.006271:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b760baa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12862d expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403171.006281:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2466b6400) 00010000:00010000:0.0:1789403171.006284:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403171.006287:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0a00, rc 0) 00000100:00100000:2.0:1789403171.006976:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:6190:x1876325038034304:12345-192.168.203.43@tcp:101: Request processed in 1009us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403171.006984:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1789403171.063370:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403171.063417:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050664832:0@lo:41: 00000100:00100000:1.0:1789403171.063503:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403171.063612:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664832 00000100:00100000:3.0:1789403171.063621:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664832 00000100:00100000:3.0:1789403171.063681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789403171.063691:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050664832:12345-0@lo:41: 00000004:00000024:3.0:1789403171.063725:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403171.063793:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050664832:12345-0@lo:41: Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403171.063801:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789403171.063829:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050664832:0@lo:41: 00010000:00010000:3.0:1789403171.316670:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403172.082034:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050664960:0@lo:41: 00000100:00100000:1.0:1789403172.082108:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403172.082265:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050664960 00000100:00100000:3.0:1789403172.082274:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050664960 00000100:00100000:3.0:1789403172.082322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789403172.082331:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050664960:12345-0@lo:41: 00000004:00000024:3.0:1789403172.082361:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789403172.087502:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050664960:12345-0@lo:41: Request processed in 5161us (5383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403172.087517:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403172.088587:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050664960:0@lo:41: 00010000:00010000:2.0:1789403172.337772:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403172.593932:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050665088:0@lo:13: 00000100:00100000:0.0:1789403172.594021:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403172.594366:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050665216:0@lo:13: 00000100:00100000:2.0:1789403172.594425:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403172.594851:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665088 00000100:00100000:1.0:1789403172.594860:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665088 00000100:00100000:1.0:1789403172.594906:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665216 00000100:00100000:1.0:1789403172.594923:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665216 00000100:00100000:1.0:1789403172.594944:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789403172.594963:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403172.594969:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050665088:12345-0@lo:13: 00002000:00000024:1.0:1789403172.594999:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403172.595046:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050665088:12345-0@lo:13: Request processed in 80us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403172.595053:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403172.595067:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403172.595072:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050665216:12345-0@lo:13: 00002000:00000024:1.0:1789403172.595081:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403172.595101:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050665216:12345-0@lo:13: Request processed in 29us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403172.595105:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403172.595123:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050665472:0@lo:400: 00000100:00100000:1.0:1789403172.595148:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403172.595168:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050665984:0@lo:400: 00000100:00100000:0.0:1789403172.595169:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050665600:0@lo:400: 00000100:00100000:1.0:1789403172.595186:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403172.595202:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665472 00000100:00100000:0.0:1789403172.595205:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665472 00000100:00100000:0.0:1789403172.595240:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665984 00000100:00100000:0.0:1789403172.595243:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665984 00000100:00100000:3.0:1789403172.595307:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789403172.595324:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050665472:12345-0@lo:400: 00000100:00100000:2.0:1789403172.596675:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050665344:0@lo:400: 00000100:00100000:3.0:1789403172.601740:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050665472:12345-0@lo:400: Request processed in 6407us (6578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403172.601755:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789403172.602024:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050665728:0@lo:400: 00000100:00100000:3.0:1789403172.602088:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403172.602275:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050666240:0@lo:400: 00000100:00100000:3.0:1789403172.602305:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789403172.602548:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142503480 x1876325050665216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403172.602559:0:3629:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789403172.602583:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050665216:0@lo:13: 00000100:00100000:3.0:1789403172.602621:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665728 00000100:00100000:3.0:1789403172.602627:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665728 00000100:00100000:3.0:1789403172.602666:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789403172.602674:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050665728:12345-0@lo:400: 00000100:00100000:3.0:1789403172.602728:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050665728:12345-0@lo:400: Request processed in 54us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403172.602734:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789403172.602752:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666240 00000100:00100000:3.0:1789403172.602755:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666240 00000100:00100000:0.0:1789403172.603310:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403172.603417:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050666112:0@lo:400: 00000100:00100000:0.0:1789403172.603451:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789403172.603492:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3e300 x1876325050665088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403172.603509:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050665088:0@lo:13: 00000100:00100000:0.0:1789403172.603540:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666112 00000100:00100000:0.0:1789403172.603545:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666112 00000100:00100000:1.0:1789403172.605658:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050666496:0@lo:400: 00000100:00100000:2.0:1789403172.605676:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403172.605759:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403172.605772:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050666112:12345-0@lo:400: 00000100:00100000:1.0:1789403172.605821:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403172.605823:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050665856:0@lo:400: 00000100:00100000:2.0:1789403172.605860:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403172.605878:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050665472:0@lo:400: 00000100:00100000:2.0:1789403172.605886:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050666368:0@lo:400: 00000100:00100000:2.0:1789403172.605922:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403172.606033:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050666112:12345-0@lo:400: Request processed in 264us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.606040:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789403172.606078:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403172.606084:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403172.606095:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665600 00000100:00100000:0.0:1789403172.606113:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665600 00000100:00100000:0.0:1789403172.606508:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666496 00000100:00100000:0.0:1789403172.606513:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666496 00000100:00100000:0.0:1789403172.606537:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665856 00000100:00100000:0.0:1789403172.606540:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665856 00000100:00100000:0.0:1789403172.606557:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666368 00000100:00100000:0.0:1789403172.606560:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666368 00000100:00100000:0.0:1789403172.606575:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789403172.606581:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050665600:12345-0@lo:400: 00000100:00100000:0.0:1789403172.606648:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050665600:12345-0@lo:400: Request processed in 66us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.606655:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789403172.606668:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403172.606675:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050666496:12345-0@lo:400: 00000100:00100000:0.0:1789403172.606710:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050666496:12345-0@lo:400: Request processed in 36us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.606716:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403172.606728:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403172.606735:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050665856:12345-0@lo:400: 00000100:00100000:0.0:1789403172.606769:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050665856:12345-0@lo:400: Request processed in 35us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.606774:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403172.606785:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403172.608438:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050666368:12345-0@lo:400: 00000100:00100000:0.0:1789403172.608522:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050666368:12345-0@lo:400: Request processed in 110us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.608529:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403172.608601:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050665856:0@lo:400: 00000100:00100000:0.0:1789403172.608613:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050666368:0@lo:400: 00000100:00080000:0.0:1789403172.608646:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403172.608650:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403172.608671:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050665600:0@lo:400: 00010000:00080000:0.0:1789403172.608686:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7b800 x1876325050666112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403172.608716:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050666112:0@lo:400: 00000100:00100000:0.0:1789403172.608745:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050665344 00000100:00100000:0.0:1789403172.608753:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050665344 00000100:00100000:0.0:1789403172.608796:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789403172.608803:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050665344:12345-0@lo:400: 00000100:00100000:0.0:1789403172.608841:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050665344:12345-0@lo:400: Request processed in 39us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.608847:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789403172.608881:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050665344:0@lo:400: 00000100:00100000:0.0:1789403172.608930:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789403172.608938:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050665984:12345-0@lo:400: 00000100:00100000:0.0:1789403172.608969:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050665984:12345-0@lo:400: Request processed in 33us (13782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403172.608975:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789403172.609101:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79c00 x1876325050665984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403172.609112:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050665984:0@lo:400: 00010000:00080000:0.0:1789403172.609204:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79180 x1876325050666496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403172.609214:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050666496:0@lo:400: 00000100:00100000:0.0:1789403172.609275:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050665728:0@lo:400: 00000100:00100000:3.0:1789403172.613603:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403172.613621:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050666240:12345-0@lo:400: 00000100:00100000:3.0:1789403172.613884:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050666240:12345-0@lo:400: Request processed in 269us (11577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403172.613892:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789403172.613955:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7a300 x1876325050666240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403172.613970:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050666240:0@lo:400: 00000001:00100000:0.0:1789403173.112243:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000001:00080000:0.0:1789403173.112261:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789403173.335536:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403173.335661:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034432 00000100:00100000:0.0:1789403173.335672:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034432 00000100:00080000:2.0:1789403173.335746:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403173.335768:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1789403173.335780:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:6243:x1876325038034432:12345-192.168.203.43@tcp:41: 00000004:00000024:0.0:1789403173.335817:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789403173.335885:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:6243:x1876325038034432:12345-192.168.203.43@tcp:41: Request processed in 107us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403173.335893:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1789403173.340922:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403173.341086:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034560 00000100:00100000:0.0:1789403173.341100:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034560 00000100:00100000:0.0:1789403173.341194:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1789403173.341206:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6243:x1876325038034560:12345-192.168.203.43@tcp:41: 00000004:00000024:0.0:1789403173.341254:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789403173.341518:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6243:x1876325038034560:12345-192.168.203.43@tcp:41: Request processed in 314us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403173.341528:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00080000:2.0:1789403173.341595:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403173.344976:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403173.345119:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034688 00000100:00100000:1.0:1789403173.345133:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034688 00000100:00100000:1.0:1789403173.345217:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403173.345230:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6243:x1876325038034688:12345-192.168.203.43@tcp:13: 00002000:00000024:1.0:1789403173.345271:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403173.345378:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:6243:x1876325038034688:12345-192.168.203.43@tcp:13: Request processed in 151us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403173.345450:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00080000:2.0:1789403173.346170:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403173.348793:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403173.349018:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034816 00000100:00100000:1.0:1789403173.349032:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034816 00000100:00100000:1.0:1789403173.349128:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403173.349146:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:6243:x1876325038034816:12345-192.168.203.43@tcp:13: 00002000:00000024:1.0:1789403173.349179:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403173.349271:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:6243:x1876325038034816:12345-192.168.203.43@tcp:13: Request processed in 133us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403173.349279:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00080000:2.0:1789403173.349945:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789403173.363923:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403174.385774:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789403175.157570:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000001:00100000:2.0:1789403175.162060:0:7431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00010000:00010000:3.0:1789403175.410329:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403175.666332:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050666752:0@lo:13: 00000100:00100000:3.0:1789403175.666443:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403175.666523:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403175.666531:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050666624:0@lo:13: 00000100:00100000:3.0:1789403175.666554:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403175.666587:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666752 00000100:00100000:3.0:1789403175.666606:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666752 00000100:00100000:3.0:1789403175.666662:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666624 00000100:00100000:3.0:1789403175.666665:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666624 00000100:00100000:3.0:1789403175.666683:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403175.666691:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050666752:12345-0@lo:13: 00002000:00000024:3.0:1789403175.666727:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403175.666775:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050666752:12345-0@lo:13: Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403175.666783:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403175.666800:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403175.666807:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050666624:12345-0@lo:13: 00002000:00000024:3.0:1789403175.666816:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403175.666839:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050666624:12345-0@lo:13: Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403175.666844:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789403175.666863:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403175.666905:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142503100 x1876325050666624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403175.666950:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050666624:0@lo:13: 00010000:00080000:3.0:1789403175.666965:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2c000 x1876325050666752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403175.666976:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050666752:0@lo:13: 00000100:00100000:0.0:1789403176.015587:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403176.015626:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403176.015657:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403176.015680:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403176.015700:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403176.015730:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035072 00000100:00100000:0.0:1789403176.015741:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035072 00000100:00100000:0.0:1789403176.015812:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035200 00000100:00100000:0.0:1789403176.015815:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035200 00000100:00100000:0.0:1789403176.015840:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1789403176.015850:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038035072:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1789403176.015957:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038035072:12345-192.168.203.43@tcp:400: Request processed in 108us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403176.015965:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1789403176.015984:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1789403176.015991:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038035200:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1789403176.016014:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038035200:12345-192.168.203.43@tcp:400: Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403176.016020:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1789403176.016040:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035328 00000100:00100000:0.0:1789403176.016044:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035328 00000100:00100000:0.0:1789403176.016069:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035456 00000100:00100000:0.0:1789403176.016072:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035456 00000100:00100000:0.0:1789403176.016089:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1789403176.016095:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038035328:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1789403176.016120:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038035328:12345-192.168.203.43@tcp:400: Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403176.016125:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1789403176.016135:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1789403176.016141:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038035456:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1789403176.016161:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038035456:12345-192.168.203.43@tcp:400: Request processed in 20us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403176.016166:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00080000:0.0:1789403176.016181:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403176.016185:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403176.016188:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403176.016196:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403176.017949:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038034944 00000100:00100000:0.0:1789403176.017969:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038034944 00000100:00100000:0.0:1789403176.018046:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:0.0:1789403176.018057:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038034944:12345-192.168.203.43@tcp:400: 00000100:00100000:0.0:1789403176.018142:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038034944:12345-192.168.203.43@tcp:400: Request processed in 87us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403176.018148:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00000001:02000400:1.0:1789403176.141384:0:10166:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789403176.188112:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000100:00100000:2.0:1789403176.193188:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403176.193222:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050666880:0@lo:41: 00000100:00100000:2.0:1789403176.193308:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403176.193599:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050666880 00000100:00100000:3.0:1789403176.193609:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050666880 00000100:00100000:3.0:1789403176.193666:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403176.193677:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050666880:12345-0@lo:41: 00000004:00000024:3.0:1789403176.193721:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403176.193785:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050666880:12345-0@lo:41: Request processed in 110us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403176.193792:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789403176.193937:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050666880:0@lo:41: 00010000:00010000:2.0:1789403176.434586:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403177.202099:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050667008:0@lo:41: 00000100:00100000:0.0:1789403177.202194:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403177.202300:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667008 00000100:00100000:0.0:1789403177.202311:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667008 00000100:00100000:0.0:1789403177.202377:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789403177.202420:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050667008:12345-0@lo:41: 00000004:00000024:0.0:1789403177.202486:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789403177.202544:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050667008:12345-0@lo:41: Request processed in 158us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403177.202552:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789403177.207047:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050667008:0@lo:41: 00010000:00010000:2.0:1789403177.460422:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403177.713759:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050667136:0@lo:13: 00000100:00100000:1.0:1789403177.713855:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403177.713993:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667136 00000100:00100000:0.0:1789403177.714003:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667136 00000100:00100000:0.0:1789403177.714079:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403177.714089:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050667136:12345-0@lo:13: 00002000:00000024:0.0:1789403177.714123:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403177.714174:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050667136:12345-0@lo:13: Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403177.714181:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789403177.714242:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7b800 x1876325050667136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403177.714253:0:3628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789403177.714285:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050667136:0@lo:13: 00000100:00080000:1.0:1789403177.714458:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403177.714662:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050667392:0@lo:400: 00000100:00100000:1.0:1789403177.714704:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.714733:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050667904:0@lo:400: 00000100:00100000:1.0:1789403177.714751:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.714764:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050668416:0@lo:400: 00000100:00100000:1.0:1789403177.714779:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.714795:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789403177.714799:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050667520:0@lo:400: 00000100:00100000:1.0:1789403177.714815:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.714829:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050668032:0@lo:400: 00000100:00100000:1.0:1789403177.714847:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.714885:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050668544:0@lo:400: 00000100:00100000:1.0:1789403177.714907:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.714939:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667392 00000100:00100000:1.0:1789403177.714945:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667392 00000100:00100000:1.0:1789403177.714973:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667904 00000100:00100000:1.0:1789403177.714976:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667904 00000100:00100000:1.0:1789403177.714996:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050668416 00000100:00100000:1.0:1789403177.714998:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050668416 00000100:00100000:1.0:1789403177.715009:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667520 00000100:00100000:1.0:1789403177.715012:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667520 00000100:00100000:1.0:1789403177.715025:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403177.715031:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050667392:12345-0@lo:400: 00000100:00100000:1.0:1789403177.715082:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050667392:12345-0@lo:400: Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.715089:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403177.715106:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789403177.715113:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050667904:12345-0@lo:400: 00000100:00100000:1.0:1789403177.715137:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050667904:12345-0@lo:400: Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.715142:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789403177.715152:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789403177.715156:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050668416:12345-0@lo:400: 00000100:00100000:1.0:1789403177.715175:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050668416:12345-0@lo:400: Request processed in 19us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.715179:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789403177.715188:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789403177.715192:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050667520:12345-0@lo:400: 00000100:00100000:1.0:1789403177.715210:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050667520:12345-0@lo:400: Request processed in 17us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.715220:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789403177.715234:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403177.715253:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050667520:0@lo:400: 00000100:00100000:1.0:1789403177.715262:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050667392:0@lo:400: 00010000:00080000:1.0:1789403177.715270:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64b480 x1876325050667904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403177.715289:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050667904:0@lo:400: 00010000:00080000:1.0:1789403177.715297:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431ff800 x1876325050668416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403177.715303:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050668416:0@lo:400: 00000100:00100000:0.0:1789403177.715624:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050668032 00000100:00100000:0.0:1789403177.715629:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050668032 00000100:00080000:1.0:1789403177.715944:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403177.716001:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050668544 00000100:00100000:0.0:1789403177.716005:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050668544 00000100:00080000:1.0:1789403177.716121:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403177.717001:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050667264:0@lo:400: 00000100:00100000:3.0:1789403177.717213:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403177.717258:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050667776:0@lo:400: 00000100:00100000:1.0:1789403177.717348:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667264 00000100:00100000:1.0:1789403177.717354:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667264 00000100:00100000:1.0:1789403177.717534:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789403177.717543:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050667264:12345-0@lo:400: 00000100:00100000:1.0:1789403177.718232:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050667264:12345-0@lo:400: Request processed in 686us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.718242:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789403177.718528:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403177.718542:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050668032:12345-0@lo:400: 00000100:00100000:2.0:1789403177.718606:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050668032:12345-0@lo:400: Request processed in 69us (3756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403177.718613:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403177.718629:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789403177.718637:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050668544:12345-0@lo:400: 00000100:00100000:2.0:1789403177.718669:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050668544:12345-0@lo:400: Request processed in 34us (3760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403177.718675:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789403177.721198:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649180 x1876325050668032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403177.721220:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050668032:0@lo:400: 00010000:00080000:1.0:1789403177.721235:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fea00 x1876325050668544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403177.721259:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050668544:0@lo:400: 00000100:00100000:3.0:1789403177.722014:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403177.722076:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050668288:0@lo:400: 00000100:00100000:3.0:1789403177.722139:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403177.722183:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050667264:0@lo:400: 00000100:00100000:3.0:1789403177.722198:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789403177.722205:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050667648:0@lo:400: 00000100:00100000:3.0:1789403177.722244:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403177.722269:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050668160:0@lo:400: 00000100:00100000:3.0:1789403177.722433:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403177.722453:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050668672:0@lo:13: 00000100:00100000:3.0:1789403177.722474:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403177.723426:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667776 00000100:00100000:1.0:1789403177.723438:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667776 00000100:00100000:1.0:1789403177.723511:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050668288 00000100:00100000:1.0:1789403177.723514:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050668288 00000100:00100000:1.0:1789403177.723541:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789403177.723551:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050667776:12345-0@lo:400: 00000100:00100000:1.0:1789403177.723635:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050667776:12345-0@lo:400: Request processed in 86us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.723642:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789403177.723660:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789403177.723667:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050668288:12345-0@lo:400: 00000100:00100000:1.0:1789403177.723696:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050668288:12345-0@lo:400: Request processed in 30us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.723701:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789403177.723720:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403177.725253:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050668160 00000100:00100000:1.0:1789403177.725268:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050668160 00000100:00100000:1.0:1789403177.725362:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403177.725373:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050668160:12345-0@lo:400: 00000100:00100000:1.0:1789403177.725476:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050668160:12345-0@lo:400: Request processed in 106us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403177.725483:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789403177.725515:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403177.725691:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050667648 00000100:00100000:3.0:1789403177.725698:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050667648 00000100:00100000:3.0:1789403177.725742:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789403177.725749:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050667648:12345-0@lo:400: 00000100:00100000:3.0:1789403177.725787:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050667648:12345-0@lo:400: Request processed in 39us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403177.725792:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789403177.725816:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050668672 00000100:00100000:3.0:1789403177.725819:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050668672 00000100:00100000:3.0:1789403177.725843:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789403177.725848:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050668672:12345-0@lo:13: 00002000:00000024:3.0:1789403177.725865:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403177.725911:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050668672:12345-0@lo:13: Request processed in 62us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403177.725917:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789403177.725961:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050667648:0@lo:400: 00010000:00080000:3.0:1789403177.725976:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fdc00 x1876325050668160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403177.725987:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050668160:0@lo:400: 00010000:00080000:3.0:1789403177.725997:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a277b72300 x1876325050668672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403177.726008:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050668672:0@lo:13: 00000100:00100000:3.0:1789403177.726038:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050667776:0@lo:400: 00000100:00100000:3.0:1789403177.726050:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050668288:0@lo:400: 00010000:00010000:3.0:1789403178.481712:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403179.506380:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789403179.603305:0:10313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd739e1da0 20000000:00000080:3.0:1789403179.603327:0:10313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a14350c000 uarg=0000000000000000 20000000:01000000:3.0:1789403179.603433:0:10313:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789403179.603436:0:10313:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789403179.603439:0:10313:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789403179.603445:0:10313:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789403179.603451:0:10313:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789403179.603516:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789403179.603519:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789403179.609717:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789403179.610295:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789403179.610333:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789403179.610348:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789403179.610363:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789403179.610366:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789403179.612240:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1789403179.612583:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1789403179.612611:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1789403179.612624:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1789403179.612635:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789403179.612638:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789403179.613245:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789403179.613712:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789403179.613741:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789403179.613758:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789403179.613769:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789403179.613772:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789403179.617892:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789403179.618251:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789403179.618300:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789403179.618317:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789403179.618333:0:10313:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789403179.618336:0:10313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789403179.619132:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1789403179.619332:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1789403179.619357:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1789403179.619370:0:10313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1789403179.619412:0:10313:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789403179.619437:0:10313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619459:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619598:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619621:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619629:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619636:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619644:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619652:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619660:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619667:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619679:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619687:0:10313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619695:0:10313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619757:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619776:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 9 pid: 6493 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.619794:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050668800:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403179.619973:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.619983:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 9 pid: 6495 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.619991:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050668928:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403179.620023:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620032:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 23 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620043:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669056:0@lo:104: 00000100:00100000:0.0:1789403179.620090:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403179.620136:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620145:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620166:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669184:0@lo:104: 00000100:00100000:0.0:1789403179.620190:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403179.620224:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620232:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620240:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669312:0@lo:104: 00000100:00100000:0.0:1789403179.620277:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403179.620299:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620307:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620315:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669440:0@lo:104: 00000100:00100000:0.0:1789403179.620338:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403179.620354:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620362:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 23 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620370:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669568:0@lo:104: 00010000:00010000:0.0:1789403179.620425:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620446:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 23 pid: 6492 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620455:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669696:0@lo:104: 00000100:00100000:1.0:1789403179.620458:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789403179.620483:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.620502:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669056 00000100:00100000:1.0:1789403179.620511:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669056 00000100:00100000:1.0:1789403179.620553:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669184 00000100:00100000:1.0:1789403179.620556:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669184 00000100:00100000:1.0:1789403179.620565:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669312 00000100:00100000:1.0:1789403179.620567:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669312 00000100:00100000:1.0:1789403179.620575:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669440 00000100:00100000:1.0:1789403179.620578:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669440 00000100:00100000:1.0:1789403179.620585:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669568 00000100:00100000:1.0:1789403179.620588:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669568 00000100:00100000:1.0:1789403179.620600:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789403179.620611:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+7:10313:x1876325050669056:12345-0@lo:104: 00000100:00100000:0.0:1789403179.620625:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403179.620628:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620668:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620679:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620688:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669824:0@lo:104: 00010000:00010000:1.0:1789403179.620694:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403179.620702:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+7:10313:x1876325050669056:12345-0@lo:104: Request processed in 93us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.620711:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403179.620717:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.620734:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669696 00000100:00100000:1.0:1789403179.620739:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669696 00010000:00010000:0.0:1789403179.620741:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620752:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 23 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.620755:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669824 00000100:00100000:1.0:1789403179.620760:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669824 00000100:00100000:0.0:1789403179.620765:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669952:0@lo:104: 00000100:00100000:1.0:1789403179.620776:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789403179.620784:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+8:10313:x1876325050669184:12345-0@lo:104: 00000100:00100000:0.0:1789403179.620790:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403179.620794:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620811:0:10313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403179.620821:0:10313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 23 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.620831:0:10313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050670080:0@lo:104: 00010000:00010000:1.0:1789403179.620837:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789403179.620847:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+8:10313:x1876325050669184:12345-0@lo:104: Request processed in 64us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.620875:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403179.620880:0:10313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.620894:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050669952 00000100:00100000:0.0:1789403179.620897:0:10313:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403179.620900:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050669952 00000100:00100000:1.0:1789403179.620915:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670080 00000100:00100000:1.0:1789403179.620919:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670080 00000100:00100000:0.0:1789403179.620925:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669056:0@lo:104: 00000100:00100000:1.0:1789403179.620936:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403179.620939:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669184:0@lo:104: 00000100:00100000:1.0:1789403179.620947:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:10313:x1876325050669312:12345-0@lo:104: 00010000:00010000:1.0:1789403179.620956:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621008:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789403179.621015:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+9:10313:x1876325050669312:12345-0@lo:104: Request processed in 71us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.621021:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789403179.621037:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403179.621044:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+8:10313:x1876325050669440:12345-0@lo:104: 00010000:00010000:1.0:1789403179.621052:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.621091:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669312:0@lo:104: 00010000:00010000:1.0:1789403179.621095:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789403179.621102:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669440:0@lo:104: 00000100:00100000:1.0:1789403179.621104:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+8:10313:x1876325050669440:12345-0@lo:104: Request processed in 59us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.621112:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789403179.621142:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789403179.621152:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621160:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403179.621168:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+7:10313:x1876325050669568:12345-0@lo:104: 00010000:00010000:1.0:1789403179.621181:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621183:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403179.621190:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621206:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403179.621217:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403179.621223:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403179.621238:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789403179.621245:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+7:10313:x1876325050669568:12345-0@lo:104: Request processed in 77us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.621251:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403179.621263:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403179.621270:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:10313:x1876325050669696:12345-0@lo:104: 00010000:00010000:3.0:1789403179.621271:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621280:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403179.621281:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621304:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621311:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:3.0:1789403179.621313:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a241514e00/0x5fb08b1e5b760b4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b56 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621319:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:10313:x1876325050669696:12345-0@lo:104: Request processed in 49us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.621331:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789403179.621340:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789403179.621345:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621347:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789403179.621358:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947e00 already unused, calling callback (ffffffffc120dc20) 00000100:00100000:1.0:1789403179.621358:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:10313:x1876325050669824:12345-0@lo:104: 10000000:00010000:3.0:1789403179.621364:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621369:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621414:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403179.621424:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403179.621430:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403179.621430:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789403179.621440:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:10313:x1876325050669824:12345-0@lo:104: Request processed in 84us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.621447:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789403179.621453:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621460:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789403179.621462:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789403179.621469:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:10313:x1876325050669952:12345-0@lo:104: 00010000:00010000:1.0:1789403179.621478:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621491:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621501:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b33 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621512:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789403179.621515:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789403179.621522:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621522:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:10313:x1876325050669952:12345-0@lo:104: Request processed in 50us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403179.621536:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1789403179.621537:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403179.621542:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621550:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621554:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 10000000:00010000:3.0:1789403179.621563:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621564:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:10313:x1876325050670080:12345-0@lo:104: 00010000:00010000:1.0:1789403179.621573:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403179.621582:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403179.621605:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621609:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789403179.621616:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789403179.621619:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:10313:x1876325050670080:12345-0@lo:104: Request processed in 56us (740us total) trans 0 rc 0/0 00010000:00010000:3.0:1789403179.621625:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.621629:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789403179.621638:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1200/0x5fb08b1e5b760b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760b17 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621649:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789403179.621652:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789403179.621658:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621659:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621676:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184200 already unused, calling callback (ffffffffc120dc20) 00010000:00010000:1.0:1789403179.621678:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a26400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403179.621681:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403179.621683:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621695:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621699:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403179.621705:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403179.621712:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403179.621716:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403179.621725:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403179.621732:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621741:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403179.621755:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621756:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621774:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403179.621775:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270184200/0x5fb08b1e5b760aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ad1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621781:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621787:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789403179.621790:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a26400/0x5fb08b1e5b760ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760aed expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621792:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621808:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a26e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403179.621811:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621813:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789403179.621819:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621822:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621832:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403179.621837:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403179.621838:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403179.621863:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403179.621872:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403179.621880:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621883:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403179.621890:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403179.621897:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403179.621905:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621912:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621913:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a26e00/0x5fb08b1e5b760abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ac3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621932:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403179.621937:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403179.621939:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621949:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621966:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a26600 already unused, calling callback (ffffffffc120dc20) 00010000:00010000:1.0:1789403179.621970:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b760aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ab5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403179.621971:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.621991:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.621995:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403179.622001:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403179.622003:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622017:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946400 already unused, calling callback (ffffffffc120dc20) 10000000:01000000:3.0:1789403179.622019:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789403179.622023:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622033:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622039:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403179.622040:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622057:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1789403179.622058:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403179.622065:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622073:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a26600/0x5fb08b1e5b760a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a76 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622078:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622084:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403179.622086:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403179.622088:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403179.622092:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403179.622094:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622102:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b760a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a4c expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403179.622110:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050670208:0@lo:103: 00010000:00010000:1.0:1789403179.622119:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403179.622128:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403179.622131:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403179.622156:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.622158:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050670592:0@lo:103: 00000100:00100000:3.0:1789403179.622197:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050670720:0@lo:103: 00000100:00100000:1.0:1789403179.622201:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.622230:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050671104:0@lo:103: 00000100:00100000:3.0:1789403179.622240:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.622260:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403179.622268:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050671232:0@lo:103: 00000100:00100000:3.0:1789403179.622295:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.622305:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050670336:0@lo:103: 00000100:00100000:3.0:1789403179.622328:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050670464:0@lo:103: 00000100:00100000:1.0:1789403179.622336:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.622355:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050670848:0@lo:103: 00000100:00100000:3.0:1789403179.622364:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403179.622380:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050670976:0@lo:103: 00000100:00100000:1.0:1789403179.622415:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403179.622444:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403179.622460:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670208 00000100:00100000:1.0:1789403179.622468:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670208 00000100:00100000:3.0:1789403179.622477:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670592 00000100:00100000:3.0:1789403179.622483:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670592 00010000:00010000:1.0:1789403179.622494:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 25 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622505:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 25 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.622515:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670720 00000100:00100000:1.0:1789403179.622521:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670720 00000100:00100000:3.0:1789403179.622525:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671104 00000100:00100000:3.0:1789403179.622530:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671104 00010000:00010000:1.0:1789403179.622539:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 27 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622546:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 27 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.622557:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671232 00000100:00100000:3.0:1789403179.622563:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670336 00000100:00100000:1.0:1789403179.622564:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671232 00000100:00100000:3.0:1789403179.622568:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670336 00010000:00010000:1.0:1789403179.622585:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 29 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622587:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 29 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.622610:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670464 00000100:00100000:3.0:1789403179.622613:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670848 00000100:00100000:1.0:1789403179.622615:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670464 00000100:00100000:3.0:1789403179.622618:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670848 00010000:00010000:1.0:1789403179.622633:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 31 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.622636:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 31 pid: 6492 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403179.622652:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050670976 00000100:00100000:3.0:1789403179.622656:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050670976 00010000:00010000:3.0:1789403179.622668:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 32 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.622682:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789403179.622692:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a606850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+32:3629:x1876325050670208:12345-0@lo:103: 00010000:00010000:1.0:1789403179.622705:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403179.622712:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 32 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622722:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 32 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622736:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b760b56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760b4f expref: 32 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.622753:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403179.622789:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a606850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+31:3629:x1876325050670208:12345-0@lo:103: Request processed in 99us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403179.622890:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669568:0@lo:104: 00000100:00100000:0.0:1789403179.622901:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669696:0@lo:104: 00000100:00100000:0.0:1789403179.622908:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669824:0@lo:104: 00000100:00100000:0.0:1789403179.622916:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050669952:0@lo:104: 00000100:00100000:0.0:1789403179.622923:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050670080:0@lo:104: 00000100:00100000:3.0:1789403179.623011:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403179.623020:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+31:3628:x1876325050670592:12345-0@lo:103: 00010000:00010000:3.0:1789403179.623029:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403179.623034:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 31 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.623043:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 31 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.623053:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184000/0x5fb08b1e5b760ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760aca expref: 31 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.623062:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403179.623105:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+30:3628:x1876325050670592:12345-0@lo:103: Request processed in 87us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403179.623112:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403179.623129:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403179.623135:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+29:3629:x1876325050670720:12345-0@lo:103: 00010000:00010000:3.0:1789403179.623142:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403179.623147:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 29 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.623155:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 29 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.623165:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760ae6 expref: 29 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.623184:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403179.623209:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+28:3629:x1876325050670720:12345-0@lo:103: Request processed in 74us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403179.623215:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403179.623229:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789403179.623235:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+27:3628:x1876325050671104:12345-0@lo:103: 00010000:00010000:3.0:1789403179.623242:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403179.623247:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 27 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.624463:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 27 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.624935:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760a6f expref: 27 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.624953:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403179.625031:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+26:3628:x1876325050671104:12345-0@lo:103: Request processed in 1795us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403179.625042:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789403179.625081:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403179.625095:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+25:3629:x1876325050671232:12345-0@lo:103: 00010000:00010000:3.0:1789403179.625112:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403179.625119:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 25 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.625128:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 25 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.625154:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b760a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760a45 expref: 25 pid: 6495 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.625165:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403179.625193:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050671232:12345-0@lo:103: Request processed in 104us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403179.625199:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403179.625216:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403179.625222:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3626:x1876325050670336:12345-0@lo:103: 00010000:00010000:3.0:1789403179.625230:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403179.625236:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.625246:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.625256:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760b2c expref: 23 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403179.625447:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050670592:0@lo:103: 00000100:00100000:0.0:1789403179.625459:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050671104:0@lo:103: 00010000:00010000:3.0:1789403179.626377:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403179.626538:0:7451:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789403179.626551:0:7451:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1789403179.626837:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403179.626846:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403179.626870:0:6486:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789403179.626885:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403179.626898:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a605050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3626:x1876325050670848:12345-0@lo:103: 00010000:00010000:2.0:1789403179.626915:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403179.626923:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 22 pid: 6492 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.626945:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 22 pid: 6492 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.626959:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b760ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760abc expref: 22 pid: 6492 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.626970:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403179.627037:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a605050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3626:x1876325050670848:12345-0@lo:103: Request processed in 145us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403179.627045:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403179.627068:0:6486:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789403179.627075:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403179.627082:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3627:x1876325050670464:12345-0@lo:103: 00010000:00010000:2.0:1789403179.627090:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403179.627094:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 20 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.627102:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 20 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.627113:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27800/0x5fb08b1e5b760b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760b10 expref: 20 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.627121:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403179.627150:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3627:x1876325050670464:12345-0@lo:103: Request processed in 69us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403179.627156:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403179.627168:0:6486:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789403179.627179:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403179.627185:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:3627:x1876325050670976:12345-0@lo:103: 00010000:00010000:2.0:1789403179.627193:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403179.627198:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 18 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.627219:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 18 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.627229:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184600/0x5fb08b1e5b760ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760aae expref: 18 pid: 6493 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.627238:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403179.628306:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789403179.628502:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:3627:x1876325050670976:12345-0@lo:103: Request processed in 1314us (6057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403179.628513:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403179.628704:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:3626:x1876325050670336:12345-0@lo:103: Request processed in 3481us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403179.628713:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403179.628812:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050670464:0@lo:103: 00000100:00100000:3.0:1789403179.628825:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050670976:0@lo:103: 00000100:00100000:1.0:1789403179.637411:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050670848:0@lo:103: 00000100:00100000:1.0:1789403179.637458:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050670336:0@lo:103: 00000100:00100000:1.0:1789403179.637604:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050670208:0@lo:103: 00000100:00100000:1.0:1789403179.637614:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050670720:0@lo:103: 00000100:00100000:1.0:1789403179.637622:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050671232:0@lo:103: 00000100:00100000:0.0:1789403179.649615:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403179.649738:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050668928:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403179.649966:0:10313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10313:1876325050668800:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403179.650024:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:3.0:1789403179.650037:0:10313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403179.650088:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035584 00000100:00100000:2.0:1789403179.650098:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035584 00010000:00010000:2.0:1789403179.650143:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 10 pid: 6495 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403179.650186:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035712 00000100:00100000:2.0:1789403179.650189:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035712 00010000:00010000:2.0:1789403179.650203:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 11 pid: 6493 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.650214:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:1.0:1789403179.650231:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:166878b2-2dd8-4b83-a3c7-759691277065+11:2390:x1876325038035584:12345-192.168.203.43@tcp:103: 00010000:00010000:1.0:1789403179.650250:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403179.650265:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 11 pid: 6495 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.650278:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 11 pid: 6495 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.650300:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241514000/0x5fb08b1e5b760b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285bd expref: 11 pid: 6495 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403179.650320:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403179.650346:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1789403179.650356:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038035712:12345-192.168.203.43@tcp:103: 00010000:00010000:2.0:1789403179.650366:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403179.650371:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 10 pid: 6493 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.650412:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038035584:12345-192.168.203.43@tcp:103: Request processed in 160us (787us total) trans 0 rc 0/0 00010000:00010000:2.0:1789403179.650413:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 10 pid: 6493 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403179.650432:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00010000:00010000:2.0:1789403179.650436:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515600/0x5fb08b1e5b760b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285c4 expref: 10 pid: 6493 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650452:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650462:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650549:0:10319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650558:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650566:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650574:0:10319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650580:0:10319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403179.650585:0:10319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650594:0:10319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650623:0:10319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403179.650636:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403179.650661:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+8:2389:x1876325038035712:12345-192.168.203.43@tcp:103: Request processed in 307us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403179.650669:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00010000:00010000:3.0:1789403179.651625:0:10313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.651642:0:10313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403179.651649:0:10313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b760bb1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403180.529930:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403180.785677:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050671360:0@lo:13: 00000100:00100000:1.0:1789403180.786167:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403180.786317:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671360 00000100:00100000:0.0:1789403180.786328:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671360 00000100:00100000:0.0:1789403180.786445:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403180.786458:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050671360:12345-0@lo:13: 00002000:00000024:0.0:1789403180.786497:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403180.786703:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050671488:0@lo:13: 00000100:00100000:3.0:1789403180.786753:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403180.786794:0:8418:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789403180.786803:0:8418:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789403180.786986:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671488 00000100:00100000:3.0:1789403180.786991:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671488 00000100:00100000:3.0:1789403180.787089:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403180.787097:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050671488:12345-0@lo:13: 00002000:00000024:3.0:1789403180.787109:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403180.787142:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050671488:12345-0@lo:13: Request processed in 46us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403180.787149:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789403180.787189:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fd500 x1876325050671488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403180.787209:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050671488:0@lo:13: 00000100:00100000:0.0:1789403180.802581:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050671360:12345-0@lo:13: Request processed in 16111us (16400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403180.802601:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789403180.802779:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143595880 x1876325050671360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403180.802809:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050671360:0@lo:13: 00000100:00080000:1.0:1789403180.803515:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403180.871948:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403180.872051:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035840 00000100:00100000:3.0:1789403180.872065:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035840 00000100:00100000:3.0:1789403180.872134:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:3.0:1789403180.872147:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+8:6162:x1876325038035840:12345-192.168.203.43@tcp:101: 00010000:00010000:3.0:1789403180.872170:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403180.872195:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128634 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403180.872230:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128634 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403180.872244:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128634 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403180.872254:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185e00, rc 0) 00000100:00100000:3.0:1789403180.872331:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038035840:12345-192.168.203.43@tcp:101: Request processed in 186us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403180.872339:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:1.0:1789403180.875254:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403180.875355:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038035968 00000100:00100000:0.0:1789403180.875369:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038035968 00000100:00100000:0.0:1789403180.875484:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:0.0:1789403180.875495:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038035968:12345-192.168.203.43@tcp:501: 00000100:00100000:0.0:1789403180.875698:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038035968:12345-192.168.203.43@tcp:501: Request processed in 203us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403180.875707:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:0.0:1789403180.891254:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403180.891381:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036096 00000100:00100000:1.0:1789403180.891445:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036096 00000100:00100000:1.0:1789403180.891518:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:1.0:1789403180.891531:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038036096:12345-192.168.203.43@tcp:503: 00000100:00100000:1.0:1789403180.891703:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038036096:12345-192.168.203.43@tcp:503: Request processed in 174us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403180.891712:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:1.0:1789403180.898106:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403180.898427:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036224 00000100:00100000:0.0:1789403180.898441:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036224 00000100:00100000:0.0:1789403180.898512:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:0.0:1789403180.898524:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+9:6643:x1876325038036224:12345-192.168.203.43@tcp:502: 00000100:00100000:0.0:1789403180.898757:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+9:6643:x1876325038036224:12345-192.168.203.43@tcp:502: Request processed in 234us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403180.898766:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:0.0:1789403180.905084:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403180.907347:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036352 00000100:00100000:3.0:1789403180.907367:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036352 00000100:00100000:3.0:1789403180.907457:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:3.0:1789403180.907472:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+9:6643:x1876325038036352:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789403180.907684:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+9:6643:x1876325038036352:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 216us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403180.907693:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:3.0:1789403180.913854:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403180.917838:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036480 00000100:00100000:1.0:1789403180.917870:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036480 00000100:00100000:1.0:1789403180.917966:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:1.0:1789403180.917984:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038036480:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403180.918025:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403180.918048:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b760bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12863b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403180.918083:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b760bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12863b expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403180.918096:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b760bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12863b expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403180.918107:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05a00, rc 0) 00000100:00100000:1.0:1789403180.918201:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038036480:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 225us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403180.918208:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:1.0:1789403180.920702:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403180.920835:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036608 00000100:00100000:3.0:1789403180.920872:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036608 00000100:00100000:3.0:1789403180.920935:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:3.0:1789403180.920947:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038036608:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403180.921095:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038036608:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 149us (405us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789403180.921104:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:2.0:1789403181.129087:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403181.129200:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403181.129348:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036992 00000100:00100000:3.0:1789403181.129361:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036992 00000100:00080000:0.0:1789403181.129561:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403181.133089:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036736 00000100:00100000:1.0:1789403181.133111:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036736 00000100:00100000:2.0:1789403181.138515:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403181.138649:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403181.138700:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037120 00000100:00100000:2.0:1789403181.138713:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037120 00000100:00100000:3.0:1789403181.138818:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:3.0:1789403181.138861:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038036864 00000100:00100000:3.0:1789403181.138866:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038036864 00000100:00100000:1.0:1789403181.139578:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403181.139598:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038036736:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403181.139702:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038036736:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 112us (10629us total) trans 0 rc 0/0 00000100:00080000:0.0:1789403181.147466:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403181.147481:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403181.147485:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403181.148299:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1789403181.148323:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038037120:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403181.148440:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038037120:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 129us (9792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.148450:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1789403181.150557:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403181.150579:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038036864:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403181.150691:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038036864:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 121us (21450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.150699:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403181.150736:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038036992:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403181.150767:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038036992:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 11938us (21568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.151563:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403181.156798:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:0.0:1789403181.300628:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050671616:0@lo:41: 00000100:00100000:0.0:1789403181.300724:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.300944:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671616 00000100:00100000:2.0:1789403181.300956:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671616 00000100:00100000:2.0:1789403181.301018:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789403181.301028:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050671616:12345-0@lo:41: 00000004:00000024:2.0:1789403181.301070:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403181.301128:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050671616:12345-0@lo:41: Request processed in 101us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.301135:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789403181.301194:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050671616:0@lo:41: 10000000:01000000:1.0:1789403181.425910:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789403181.425921:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a1424b5800 from 48 10000000:01000000:1.0:1789403181.425928:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403181.425997:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.426032:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.426046:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403181.426078:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050671744:0@lo:101: 00000100:00100000:1.0:1789403181.426166:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.426487:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.428729:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671744 00000100:00100000:0.0:1789403181.428749:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671744 00000100:00100000:0.0:1789403181.434419:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789403181.434452:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+15:6497:x1876325050671744:12345-0@lo:101: 00010000:00010000:0.0:1789403181.434479:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403181.434504:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b760bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760bc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.434541:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b760bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bc6 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.434555:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b760bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bc6 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.434566:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0400, rc 0) 00000100:00100000:0.0:1789403181.434661:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050671744:12345-0@lo:101: Request processed in 227us (8494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.434668:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789403181.434860:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050671744:0@lo:101: 00010000:00010000:1.0:1789403181.434886:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.434897:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403181.435028:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050671872:0@lo:501: 00000100:00100000:1.0:1789403181.435072:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.435120:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.435202:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050671872 00000100:00100000:3.0:1789403181.435211:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050671872 00000100:00100000:3.0:1789403181.435459:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789403181.435470:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050671872:12345-0@lo:501: 00000100:00100000:3.0:1789403181.435612:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050671872:12345-0@lo:501: Request processed in 144us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.435627:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789403181.435728:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050671872:0@lo:501: 00000100:00100000:2.0:1789403181.435767:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672000:0@lo:503: 00000100:00100000:2.0:1789403181.435813:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.435849:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.436416:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672000 00000100:00100000:1.0:1789403181.436423:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672000 00000100:00100000:1.0:1789403181.436457:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789403181.436465:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050672000:12345-0@lo:503: 00000100:00100000:1.0:1789403181.437247:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050672000:12345-0@lo:503: Request processed in 770us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.437257:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789403181.440517:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672000:0@lo:503: 00000100:00100000:1.0:1789403181.449493:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10333:1876325050672128:0@lo:502: 00000100:00100000:1.0:1789403181.449788:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.449937:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.457982:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672128 00000100:00100000:0.0:1789403181.458006:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672128 00000100:00100000:0.0:1789403181.458095:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789403181.458107:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:10333:x1876325050672128:12345-0@lo:502: 00000100:00100000:0.0:1789403181.458602:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:10333:x1876325050672128:12345-0@lo:502: Request processed in 496us (8814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.458612:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789403181.470434:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10333:1876325050672128:0@lo:502: 00000100:00100000:3.0:1789403181.470554:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10333:1876325050672256:0@lo:502: 00000100:00100000:3.0:1789403181.470650:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.470702:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.471678:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672256 00000100:00100000:0.0:1789403181.471691:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672256 00000100:00100000:0.0:1789403181.471777:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789403181.471789:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:10333:x1876325050672256:12345-0@lo:502: 00000100:00100000:0.0:1789403181.472032:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:10333:x1876325050672256:12345-0@lo:502: Request processed in 246us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.472048:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789403181.472783:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10333:1876325050672256:0@lo:502: 00000040:00080000:3.0:1789403181.472828:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789403181.473513:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789403181.473546:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789403181.473560:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.473573:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403181.473584:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789403181.473587:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789403181.473590:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789403181.473633:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.473643:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.473654:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.473677:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672384:0@lo:101: 00000100:00100000:2.0:1789403181.473736:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.473797:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.473888:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672384 00000100:00100000:1.0:1789403181.473896:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672384 00000100:00100000:1.0:1789403181.473952:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789403181.473962:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+16:6497:x1876325050672384:12345-0@lo:101: 00010000:00010000:1.0:1789403181.473975:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403181.473989:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b760bdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760bd4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.474016:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b760bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bd4 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.474040:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b760bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bd4 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.474057:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05c00, rc 0) 00000100:00100000:1.0:1789403181.474113:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050672384:12345-0@lo:101: Request processed in 152us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.474120:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789403181.474437:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672384:0@lo:101: 00010000:00010000:2.0:1789403181.474455:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.474466:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.474534:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672512:0@lo:501: 00000100:00100000:2.0:1789403181.474565:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.474587:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.474684:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672512 00000100:00100000:3.0:1789403181.474689:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672512 00000100:00100000:3.0:1789403181.474731:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789403181.474739:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050672512:12345-0@lo:501: 00000100:00100000:3.0:1789403181.474886:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050672512:12345-0@lo:501: Request processed in 148us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.474894:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789403181.475625:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672512:0@lo:501: 00000100:00100000:2.0:1789403181.475675:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672640:0@lo:503: 00000100:00100000:2.0:1789403181.475738:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.475778:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.475836:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672640 00000100:00100000:3.0:1789403181.475851:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672640 00000100:00100000:3.0:1789403181.475893:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789403181.475901:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050672640:12345-0@lo:503: 00000100:00100000:3.0:1789403181.476013:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050672640:12345-0@lo:503: Request processed in 112us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.476020:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789403181.476268:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050672640:0@lo:503: 00000100:00100000:0.0:1789403181.477923:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10334:1876325050672768:0@lo:502: 00000100:00100000:0.0:1789403181.477993:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403181.478031:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.478184:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672768 00000100:00100000:3.0:1789403181.478192:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672768 00000100:00100000:3.0:1789403181.478240:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789403181.478249:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:10334:x1876325050672768:12345-0@lo:502: 00000100:00100000:3.0:1789403181.478382:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:10334:x1876325050672768:12345-0@lo:502: Request processed in 134us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.478686:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10334:1876325050672768:0@lo:502: 00000020:01000000:1.0:1789403181.478720:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403181.478731:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403181.478734:0:10334:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789403181.478739:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789403181.478762:0:10334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10334:1876325050672896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.478803:0:10334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.478824:0:10334:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.478896:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050672896 00000100:00100000:2.0:1789403181.478902:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050672896 00000100:00100000:2.0:1789403181.478925:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789403181.478932:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:10334:x1876325050672896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403181.479031:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:10334:x1876325050672896:12345-0@lo:502:llog_process_th.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.479046:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789403181.479229:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789403181.480046:0:10334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10334:1876325050672896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403181.480096:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403181.480103:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403181.480105:0:10334:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789403181.480110:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1789403181.480797:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789403181.480827:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789403181.480854:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.480869:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403181.480881:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789403181.480884:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a27b560000 from 48 10000000:01000000:3.0:1789403181.480887:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403181.480928:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.480937:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.480948:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403181.480972:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.481197:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.481455:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673024 00000100:00100000:2.0:1789403181.481463:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673024 00000100:00100000:2.0:1789403181.481514:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789403181.481525:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+17:6497:x1876325050673024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403181.481539:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403181.481566:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946a00/0x5fb08b1e5b760be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760be2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.481595:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946a00/0x5fb08b1e5b760be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760be2 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.481607:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946a00/0x5fb08b1e5b760be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760be2 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.481617:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946a00, rc 0) 00000100:00100000:2.0:1789403181.481660:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050673024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.481667:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789403181.481712:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.481729:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403181.481744:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.481754:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.481824:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.481873:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.481895:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.481955:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673152 00000100:00100000:0.0:1789403181.481960:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673152 00000100:00100000:0.0:1789403181.481992:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789403181.482000:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050673152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.482151:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050673152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.482158:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789403181.482884:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.482929:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.482984:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.483016:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.483216:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673280 00000100:00100000:0.0:1789403181.483222:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673280 00000100:00100000:0.0:1789403181.483262:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789403181.483270:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050673280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.483372:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050673280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.483379:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789403181.483470:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.483823:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10335:1876325050673408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.483877:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.483909:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.483952:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673408 00000100:00100000:1.0:1789403181.483957:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673408 00000100:00100000:1.0:1789403181.483979:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789403181.483987:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:10335:x1876325050673408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.484105:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:10335:x1876325050673408:12345-0@lo:502:llog_process_th.0 Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.484111:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789403181.484237:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10335:1876325050673408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.484276:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10335:1876325050673536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.484309:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.484329:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.484425:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673536 00000100:00100000:0.0:1789403181.484429:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673536 00000100:00100000:0.0:1789403181.484445:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789403181.484450:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:10335:x1876325050673536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403181.484516:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:10335:x1876325050673536:12345-0@lo:502:llog_process_th.0 Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.484533:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789403181.484631:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10335:1876325050673536:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789403181.484650:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789403181.484803:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789403181.484830:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403181.484851:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.484864:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403181.484875:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789403181.484877:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789403181.484880:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789403181.484909:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.484918:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.484927:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403181.484943:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.484972:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403181.485003:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.485067:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673664 00000100:00100000:1.0:1789403181.485073:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673664 00000100:00100000:1.0:1789403181.485105:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789403181.485111:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+18:6497:x1876325050673664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403181.485121:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403181.485134:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b760bf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760bf0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.485158:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b760bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bf0 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.485170:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b760bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bf0 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.485191:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05800, rc 0) 00000100:00100000:1.0:1789403181.485229:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050673664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.485234:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789403181.485685:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403181.485700:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.485723:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403181.485782:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.485814:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403181.485838:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.485952:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673792 00000100:00100000:2.0:1789403181.485959:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673792 00000100:00100000:2.0:1789403181.485986:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789403181.485994:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050673792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.486139:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050673792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.486153:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789403181.487642:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.487710:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.487782:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403181.487817:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.487852:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050673920 00000100:00100000:0.0:1789403181.487859:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050673920 00000100:00100000:0.0:1789403181.487990:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789403181.487998:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050673920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.488138:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050673920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.488145:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789403181.488366:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050673920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.488876:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10336:1876325050674048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.488924:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.488960:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.489182:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674048 00000100:00100000:1.0:1789403181.489189:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674048 00000100:00100000:1.0:1789403181.489218:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789403181.489227:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:10336:x1876325050674048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.489338:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:10336:x1876325050674048:12345-0@lo:502:llog_process_th.0 Request processed in 111us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.489346:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789403181.489498:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10336:1876325050674048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403181.489527:0:10336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403181.489539:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403181.489542:0:10336:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789403181.489548:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789403181.489571:0:10336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10336:1876325050674176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.489607:0:10336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.489636:0:10336:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.489674:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674176 00000100:00100000:1.0:1789403181.489679:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674176 00000100:00100000:1.0:1789403181.489696:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789403181.489702:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:10336:x1876325050674176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.489774:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:10336:x1876325050674176:12345-0@lo:502:llog_process_th.0 Request processed in 71us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.489781:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789403181.489856:0:10336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10336:1876325050674176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403181.489880:0:10336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403181.489884:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403181.489885:0:10336:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789403181.489890:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789403181.490634:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789403181.490663:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789403181.490675:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.490689:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403181.490716:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789403181.490719:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a281b11800 from 48 10000000:01000000:1.0:1789403181.490722:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403181.490757:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.490766:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.490777:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403181.490798:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.490859:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.490887:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.490908:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674304 00000100:00100000:1.0:1789403181.490913:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674304 00000100:00100000:1.0:1789403181.490943:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789403181.490950:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:6497:x1876325050674304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403181.490961:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403181.490981:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b760c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760bfe expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.491008:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b760c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bfe expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.491020:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b760c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760bfe expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.491048:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05200, rc 0) 00000100:00100000:1.0:1789403181.491085:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050674304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.491091:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789403181.491129:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403181.491144:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.491154:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403181.491211:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.491235:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.491247:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.491258:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674432 00000100:00100000:1.0:1789403181.491262:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674432 00000100:00100000:1.0:1789403181.491278:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789403181.491283:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050674432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.491435:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050674432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.491442:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789403181.491469:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.491495:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.491533:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.491555:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.491568:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674560 00000100:00100000:1.0:1789403181.491571:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674560 00000100:00100000:1.0:1789403181.491588:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789403181.491593:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050674560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.491660:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050674560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.491666:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789403181.491703:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.491976:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10337:1876325050674688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.492011:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.492031:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674688 00000100:00100000:1.0:1789403181.492036:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674688 00000100:00100000:1.0:1789403181.492054:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789403181.492072:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:10337:x1876325050674688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.492151:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:10337:x1876325050674688:12345-0@lo:502:llog_process_th.0 Request processed in 91us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.492158:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789403181.492186:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.492199:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10337:1876325050674688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.492237:0:10337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10337:1876325050674816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.492270:0:10337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.492288:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674816 00000100:00100000:1.0:1789403181.492292:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674816 00000100:00100000:1.0:1789403181.492308:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789403181.492314:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:10337:x1876325050674816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.492375:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:10337:x1876325050674816:12345-0@lo:502:llog_process_th.0 Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.492381:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789403181.492434:0:10337:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.492445:0:10337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10337:1876325050674816:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789403181.492464:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789403181.492516:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789403181.492531:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403181.492540:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492550:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403181.492559:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789403181.492562:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789403181.492564:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789403181.492586:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492595:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492605:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403181.492618:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.492644:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.492666:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.492679:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050674944 00000100:00100000:1.0:1789403181.492682:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050674944 00000100:00100000:1.0:1789403181.492699:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789403181.492704:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050674944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403181.492713:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403181.492723:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b760c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c0c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492743:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b760c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c0c expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492752:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b760c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c0c expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492760:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04000, rc 0) 00000100:00100000:1.0:1789403181.492785:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050674944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.492790:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789403181.492815:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050674944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403181.492826:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.492835:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403181.492891:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.492914:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.492934:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.492944:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675072 00000100:00100000:1.0:1789403181.492947:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675072 00000100:00100000:1.0:1789403181.492964:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789403181.492969:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050675072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.493058:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050675072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.493063:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789403181.493087:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.493108:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.493139:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.493151:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.493160:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675200 00000100:00100000:1.0:1789403181.493162:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675200 00000100:00100000:1.0:1789403181.493178:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789403181.493183:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050675200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.493249:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050675200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.493255:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789403181.493287:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403181.493589:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10338:1876325050675328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.493624:0:10338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.493643:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675328 00000100:00100000:1.0:1789403181.493648:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675328 00000100:00100000:1.0:1789403181.493665:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789403181.493670:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10338:x1876325050675328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.493748:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10338:x1876325050675328:12345-0@lo:502:llog_process_th.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.493755:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789403181.493782:0:10338:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403181.493794:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10338:1876325050675328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403181.493815:0:10338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403181.493824:0:10338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403181.493827:0:10338:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789403181.493833:0:10338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789403181.500227:0:10338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10338:1876325050675456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403181.500346:0:10338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403181.500436:0:10338:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.501130:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675456 00000100:00100000:2.0:1789403181.501141:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675456 00000100:00100000:2.0:1789403181.501219:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789403181.501231:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10338:x1876325050675456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403181.501428:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10338:x1876325050675456:12345-0@lo:502:llog_process_th.0 Request processed in 199us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.501436:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789403181.501657:0:10338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10338:1876325050675456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403181.501694:0:10338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403181.501702:0:10338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403181.501705:0:10338:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789403181.501711:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789403181.502254:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789403181.502277:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789403181.502290:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.502303:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403181.502316:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789403181.502319:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a244ea0000 from 48 10000000:01000000:2.0:1789403181.502322:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789403181.502357:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.502366:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.502377:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.502535:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.502593:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.502625:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.504327:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675584 00000100:00100000:0.0:1789403181.504344:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675584 00000100:00100000:1.0:1789403181.505051:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789403181.505068:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050675584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403181.505093:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403181.505117:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b760c21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c1a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.505153:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b760c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c1a expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.505167:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b760c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c1a expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.505194:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05e00, rc 0) 00000100:00100000:1.0:1789403181.505279:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050675584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403181.505286:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789403181.505713:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403181.505738:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.505748:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.505857:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.505899:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.505939:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.505992:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675712 00000100:00100000:3.0:1789403181.505999:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675712 00000100:00100000:3.0:1789403181.506040:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789403181.506047:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050675712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.506187:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050675712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.506194:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789403181.506287:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.506335:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.506374:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.506427:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.506629:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675840 00000100:00100000:0.0:1789403181.506635:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675840 00000100:00100000:0.0:1789403181.506703:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789403181.506712:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050675840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.506807:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050675840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.506824:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789403181.506901:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050675840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.507252:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10339:1876325050675968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403181.507289:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.507365:0:10339:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db780 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.507732:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050675968 00000100:00100000:3.0:1789403181.507739:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050675968 00000100:00100000:2.0:1789403181.507851:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789403181.507861:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10339:x1876325050675968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403181.507990:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10339:x1876325050675968:12345-0@lo:502:llog_process_th.0 Request processed in 131us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.508007:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789403181.508092:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10339:1876325050675968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.508141:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10339:1876325050676096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.508178:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.508206:0:10339:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.508250:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676096 00000100:00100000:2.0:1789403181.508255:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676096 00000100:00100000:2.0:1789403181.508272:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789403181.508277:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10339:x1876325050676096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403181.508345:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10339:x1876325050676096:12345-0@lo:502:llog_process_th.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.508352:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789403181.508448:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10339:1876325050676096:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789403181.508469:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789403181.508732:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789403181.508754:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789403181.508765:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.508778:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403181.508788:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789403181.508791:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789403181.508795:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789403181.508821:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.508830:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.508851:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.508866:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.508906:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.508937:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.509024:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676224 00000100:00100000:3.0:1789403181.509030:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676224 00000100:00100000:3.0:1789403181.509053:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789403181.509060:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050676224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403181.509069:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403181.509084:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c28 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.509131:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c28 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.509144:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c28 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.509154:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184200, rc 0) 00000100:00100000:3.0:1789403181.509195:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050676224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.509202:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789403181.509335:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403181.509350:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403181.509360:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403181.509447:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.509474:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.509495:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.509648:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676352 00000100:00100000:0.0:1789403181.509654:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676352 00000100:00100000:0.0:1789403181.509692:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789403181.509704:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050676352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.509821:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050676352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.509829:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789403181.510022:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.510051:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.510089:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403181.510122:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db480 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.510134:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676480 00000100:00100000:2.0:1789403181.510138:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676480 00000100:00100000:2.0:1789403181.510156:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789403181.510162:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050676480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403181.510262:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050676480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.510270:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789403181.510464:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.511639:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10340:1876325050676608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.511707:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.511748:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403181.511802:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676608 00000100:00100000:2.0:1789403181.511810:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676608 00000100:00100000:2.0:1789403181.511857:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789403181.511872:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10340:x1876325050676608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403181.512285:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10340:x1876325050676608:12345-0@lo:502:llog_process_th.0 Request processed in 414us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403181.512294:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789403181.512569:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10340:1876325050676608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403181.512603:0:10340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403181.512614:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403181.512617:0:10340:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789403181.512624:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789403181.512652:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10340:1876325050676736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403181.512690:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403181.512710:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403181.512771:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676736 00000100:00100000:0.0:1789403181.512777:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676736 00000100:00100000:0.0:1789403181.513191:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789403181.513201:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10340:x1876325050676736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403181.513317:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10340:x1876325050676736:12345-0@lo:502:llog_process_th.0 Request processed in 117us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403181.513324:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789403181.514201:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10340:1876325050676736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403181.514241:0:10340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403181.514249:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403181.514261:0:10340:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789403181.514266:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789403181.514489:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789403181.514519:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789403181.514530:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.514544:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403181.514555:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789403181.514558:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a245c9b380 from 1 10000000:01000000:0.0:1789403181.514561:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789403181.514598:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.514614:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.514626:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403181.514648:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.514701:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403181.514745:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.516295:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676864 00000100:00100000:3.0:1789403181.516310:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676864 00000100:00100000:3.0:1789403181.516386:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789403181.516414:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050676864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403181.516433:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403181.516454:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185400/0x5fb08b1e5b760c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c36 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.516488:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185400/0x5fb08b1e5b760c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c36 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.516501:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185400/0x5fb08b1e5b760c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c36 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403181.516511:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185400, rc 0) 00000100:00100000:3.0:1789403181.516592:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050676864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403181.516600:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789403181.517025:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403181.517049:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.517062:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403181.517153:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403181.517202:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403181.517244:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403181.517492:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050676992 00000100:00100000:3.0:1789403181.517499:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050676992 00000100:00100000:3.0:1789403181.517540:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789403181.517548:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050676992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403181.517640:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050676992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789403181.517648:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789403181.517765:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050676992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789403181.517800:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789403181.517808:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403181.517819:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403181.553711:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403182.325598:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050677120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403182.325703:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.326050:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050677120 00000100:00100000:2.0:1789403182.326059:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050677120 00000100:00100000:2.0:1789403182.326117:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789403182.326128:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050677120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403182.326169:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403182.326229:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050677120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.326236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789403182.327000:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050677120:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403182.577586:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789403182.759992:0:10377:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef1b94140 20000000:00000080:3.0:1789403182.760166:0:10377:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a14350f000 uarg=0000000000000000 20000000:01000000:3.0:1789403182.760221:0:10377:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789403182.760229:0:10377:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789403182.760235:0:10377:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789403182.761129:0:10378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789403182.761323:0:10377:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789403182.767954:0:10377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789403182.767999:0:10377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789403182.768015:0:10377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789403182.768033:0:10377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789403182.768061:0:10377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768084:0:10377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768094:0:10377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768101:0:10377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768121:0:10377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768132:0:10377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768163:0:10377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768215:0:10377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.768233:0:10377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 9 pid: 6493 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403182.768252:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677248:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403182.769143:0:10377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.769156:0:10377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 23 pid: 6492 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403182.769168:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677376:0@lo:104: 00000100:00100000:3.0:1789403182.769223:0:10377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403182.769270:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050677376 00000100:00100000:3.0:1789403182.769279:0:6484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050677376 00000100:00100000:3.0:1789403182.769335:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789403182.769345:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:10377:x1876325050677376:12345-0@lo:104: 00010000:00010000:3.0:1789403182.769360:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.769468:0:10377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.769477:0:10377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 23 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403182.769487:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677504:0@lo:104: 00000100:00100000:2.0:1789403182.769534:0:10377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403182.769555:0:10377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.769563:0:10377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 23 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403182.769571:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677632:0@lo:104: 00010000:00010000:2.0:1789403182.769613:0:10377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.769620:0:10377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 23 pid: 6495 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403182.769630:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677760:0@lo:104: 00000100:00100000:2.0:1789403182.769648:0:10377:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789403182.769735:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789403182.769756:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403182.769769:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403182.769777:0:6483:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789403182.769783:0:6483:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789403182.771509:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050677504 00000100:00100000:2.0:1789403182.771524:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050677504 00000100:00100000:2.0:1789403182.771577:0:6483:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789403182.771586:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050677632 00000100:00100000:2.0:1789403182.771589:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050677632 00000100:00100000:2.0:1789403182.771600:0:6483:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789403182.771619:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050677760 00000100:00100000:2.0:1789403182.771623:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050677760 00000100:00100000:1.0:1789403182.771819:0:10379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789403182.771841:0:10379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431f8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:10377:x1876325050677504:12345-0@lo:104: 00010000:00010000:1.0:1789403182.771861:0:10379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.771935:0:10379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403182.771942:0:10379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431f8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:10377:x1876325050677504:12345-0@lo:104: Request processed in 114us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403182.771950:0:10379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789403182.771976:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403182.771981:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789403182.771985:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403182.771988:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:10377:x1876325050677376:12345-0@lo:104: Request processed in 2644us (2765us total) trans 0 rc 0/0 00010000:00010000:1.0:1789403182.771993:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a27a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403182.771998:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403182.772005:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789403182.772049:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403182.772056:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:10377:x1876325050677632:12345-0@lo:104: 00010000:00010000:1.0:1789403182.772145:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.773084:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403182.773142:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677376:0@lo:104: 00000100:00100000:2.0:1789403182.773156:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677504:0@lo:104: 00010000:00010000:3.0:1789403182.773162:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403182.773163:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677632:0@lo:104: 00000100:00100000:3.0:1789403182.773168:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:10377:x1876325050677632:12345-0@lo:104: Request processed in 1114us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403182.773175:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403182.773199:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789403182.773209:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:10377:x1876325050677760:12345-0@lo:104: 00010000:00010000:3.0:1789403182.773219:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.773271:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789403182.773276:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:10377:x1876325050677760:12345-0@lo:104: Request processed in 70us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403182.773281:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789403182.773299:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789403182.773299:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677760:0@lo:104: 00010000:00010000:3.0:1789403182.773305:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.773313:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403182.773318:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.773342:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403182.773350:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403182.773356:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403182.774071:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774083:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403182.774123:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774131:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270185a00/0x5fb08b1e5b760a61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760a68 expref: -99 pid: 9493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774147:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403182.774151:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774156:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403182.774159:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403182.774160:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050677888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403182.774168:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403182.774174:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403182.774186:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403182.774206:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774212:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789403182.774213:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403182.774219:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774225:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b7608e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608ee expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774234:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403182.774236:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774241:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403182.774244:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774250:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403182.774256:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403182.774261:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789403182.774265:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403182.774270:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050678016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403182.774273:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774278:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789403182.774288:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403182.774300:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774307:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1000/0x5fb08b1e5b7608d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7608e0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.774316:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403182.774318:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403182.774320:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403182.774326:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403182.774332:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403182.774346:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050678144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403182.774373:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.774429:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050677888 00000100:00100000:3.0:1789403182.774432:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678016 00000100:00100000:3.0:1789403182.774437:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678016 00000100:00100000:2.0:1789403182.774437:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050677888 00010000:00010000:3.0:1789403182.774466:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 25 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774466:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 25 pid: 6492 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403182.774492:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678144 00000100:00100000:3.0:1789403182.774495:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678144 00000100:00100000:2.0:1789403182.774511:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403182.774519:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+26:3626:x1876325050678016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403182.774534:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403182.774541:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 26 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774552:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 26 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774568:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947000/0x5fb08b1e5b7608ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7608e7 expref: 26 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774583:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403182.774616:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+25:3626:x1876325050678016:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.774623:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403182.774638:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403182.774643:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050677888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403182.774665:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403182.774670:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 24 pid: 6492 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774678:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 24 pid: 6492 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774688:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760a68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760a61 expref: 24 pid: 6492 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.774722:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403182.774747:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3626:x1876325050677888:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.774753:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403182.774788:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050678016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403182.774796:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050677888:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789403182.775793:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403182.775806:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403182.775858:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.775866:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403182.775886:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.775894:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a27a00/0x5fb08b1e5b76093b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760942 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.775913:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403182.775915:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403182.775917:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403182.779319:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 22 pid: 6495 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403182.779381:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403182.779418:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3628:x1876325050678144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403182.779437:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403182.779444:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 22 pid: 6495 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.779457:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 22 pid: 6495 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.779491:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27600/0x5fb08b1e5b7608e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7608d9 expref: 22 pid: 6495 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403182.779511:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403182.779588:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3628:x1876325050678144:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (5214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403182.783152:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050678272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403182.783179:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403182.783260:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403182.783273:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050678144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403182.783655:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403182.783781:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10377:1876325050677248:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403182.783806:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678272 00000100:00100000:1.0:1789403182.783816:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678272 00010000:00010000:2.0:1789403182.783819:0:10377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.783871:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 21 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403182.783903:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037248 00000100:00100000:1.0:1789403182.783906:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037248 00000100:00100000:0.0:1789403182.783907:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403182.783918:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3629:x1876325050678272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403182.783919:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 10 pid: 6493 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403182.783935:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403182.783942:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 21 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403182.783946:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00010000:00010000:0.0:1789403182.783954:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 21 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403182.783967:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a605c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038037248:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403182.783973:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76093b expref: 21 pid: 6493 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.783975:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403182.783979:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 10 pid: 6493 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403182.783988:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403182.784039:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 10 pid: 6493 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784051:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b760b80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285fc expref: 10 pid: 6493 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784064:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784076:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784094:0:10319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784103:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784109:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784116:0:10319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784123:0:10319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403182.784127:0:10319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784151:0:10319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403182.784185:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3629:x1876325050678272:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403182.784192:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789403182.784206:0:10319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403182.784216:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403182.784256:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050678272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403182.784270:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a605c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+9:2390:x1876325038037248:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 303us (4280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403182.784277:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00010000:00010000:2.0:1789403182.784278:0:10377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.784286:0:10377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403182.784292:0:10377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760c44 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403182.841823:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403182.841861:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050678400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403182.841949:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.842019:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678400 00000100:00100000:2.0:1789403182.842028:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678400 00000100:00100000:2.0:1789403182.842113:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789403182.842123:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050678400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403182.842161:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403182.842211:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050678400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.842219:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789403182.842245:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789403182.842275:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fdf80 x1876325050678400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403182.842293:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050678400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403182.842950:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050678656:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.842992:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403182.843016:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050679168:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843040:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403182.843057:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050679680:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843078:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403182.843096:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789403182.843110:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050678784:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843136:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403182.843154:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050679296:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843177:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403182.843206:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678656 00000100:00100000:0.0:1789403182.843212:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678656 00000100:00100000:0.0:1789403182.843254:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403182.843261:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050678656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843304:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050678656:12345-0@lo:400:kworker.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403182.843311:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403182.843334:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679168 00000100:00100000:0.0:1789403182.843338:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679168 00000100:00100000:0.0:1789403182.843369:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679680 00000100:00100000:0.0:1789403182.843371:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679680 00000100:00100000:0.0:1789403182.843419:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679296 00000100:00100000:0.0:1789403182.843423:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679296 00000100:00100000:0.0:1789403182.843438:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403182.843444:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050679168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843476:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050679168:12345-0@lo:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403182.843482:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403182.843493:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789403182.843499:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050679680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.843525:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050679680:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403182.843530:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403182.846174:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403182.846206:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050679296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403182.846341:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050679296:12345-0@lo:400:kworker.0 Request processed in 152us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403182.846350:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403182.846622:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050679808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403182.846671:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.846881:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678784 00000100:00100000:2.0:1789403182.846891:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678784 00000100:00100000:2.0:1789403182.846936:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789403182.846944:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050678784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.846983:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050678784:12345-0@lo:400:kworker.0 Request processed in 41us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.846989:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789403182.847012:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403182.847018:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403182.847509:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050678528:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.847557:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.847581:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050679040:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.847600:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.847619:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050679552:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.847657:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.847679:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789403182.847790:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050678912:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.847816:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.847829:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050679424:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.847862:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403182.847891:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678528 00000100:00100000:2.0:1789403182.847897:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678528 00000100:00100000:2.0:1789403182.847922:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679040 00000100:00100000:2.0:1789403182.847925:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679040 00000100:00100000:2.0:1789403182.847946:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679552 00000100:00100000:2.0:1789403182.847948:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679552 00000100:00100000:2.0:1789403182.847960:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050678912 00000100:00100000:2.0:1789403182.847962:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050678912 00000100:00100000:2.0:1789403182.847972:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679424 00000100:00100000:2.0:1789403182.847974:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679424 00000100:00100000:2.0:1789403182.847988:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403182.847995:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050678528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848036:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050678528:12345-0@lo:400:kworker.0 Request processed in 41us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.848043:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403182.848058:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789403182.848064:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050679040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848089:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050679040:12345-0@lo:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.848094:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789403182.848105:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403182.848111:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050679552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848146:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050679552:12345-0@lo:400:kworker.0 Request processed in 36us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.848153:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403182.848164:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789403182.848170:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050678912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848195:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050678912:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.848201:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789403182.848213:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789403182.848218:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050679424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848240:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050679424:12345-0@lo:400:kworker.0 Request processed in 23us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403182.848246:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1789403182.848265:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403182.848269:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403182.848302:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050678912:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848312:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050679424:0@lo:400:kworker.0 00000100:00100000:2.0:1789403182.848320:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050678528:0@lo:400:kworker.0 00010000:00080000:2.0:1789403182.848331:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369b480 x1876325050679040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403182.848340:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050679040:0@lo:400:kworker.0 00010000:00080000:2.0:1789403182.848348:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a300 x1876325050679552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403182.848368:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050679552:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.848803:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679808 00000100:00100000:0.0:1789403182.848810:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679808 00000100:00100000:0.0:1789403182.848860:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789403182.848868:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050679808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403182.848889:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403182.848938:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050679808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403182.848944:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789403182.848995:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050678784:0@lo:400:kworker.0 00010000:00080000:0.0:1789403182.849010:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698e00 x1876325050679296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403182.849020:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050679296:0@lo:400:kworker.0 00000100:00100000:0.0:1789403182.849033:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050678656:0@lo:400:kworker.0 00010000:00080000:0.0:1789403182.849046:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050679168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403182.849054:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050679168:0@lo:400:kworker.0 00010000:00080000:0.0:1789403182.849066:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143699880 x1876325050679680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403182.849075:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050679680:0@lo:400:kworker.0 00010000:00080000:2.0:1789403182.849509:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fdf80 x1876325050679808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403182.849527:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050679808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789403183.601968:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789403183.931800:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403183.931812:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a1424b5800 from 4 10000000:01000000:3.0:1789403183.931818:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403183.931893:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.931908:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.931923:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403183.931956:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050679936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.932042:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.933362:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403183.934691:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050679936 00000100:00100000:0.0:1789403183.934707:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050679936 00000100:00100000:0.0:1789403183.934776:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789403183.934787:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050679936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403183.934810:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403183.934852:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c4b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403183.934888:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403183.934902:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403183.934912:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0200, rc 0) 00000100:00100000:0.0:1789403183.934993:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050679936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403183.935000:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789403183.935066:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050679936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403183.935086:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403183.935097:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403183.935189:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403183.935225:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403183.935254:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.935684:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680064 00000100:00100000:3.0:1789403183.935691:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680064 00000100:00100000:3.0:1789403183.935726:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789403183.935734:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050680064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.935878:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050680064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.935885:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789403183.937061:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403183.937119:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403183.937181:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403183.937309:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.939222:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680192 00000100:00100000:3.0:1789403183.939240:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680192 00000100:00100000:3.0:1789403183.939310:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789403183.939322:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050680192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.939546:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050680192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.939555:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789403183.940494:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.959799:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10426:1876325050680320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403183.959918:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.960026:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403183.965759:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680320 00000100:00100000:1.0:1789403183.965779:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680320 00000100:00100000:0.0:1789403183.966104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789403183.966118:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10426:x1876325050680320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403183.966346:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10426:x1876325050680320:12345-0@lo:502:llog_process_th.0 Request processed in 230us (6428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403183.966354:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789403183.966368:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10426:1876325050680320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403183.966431:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403183.966443:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403183.966445:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789403183.966452:0:10426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a1424b5800 00000020:00000080:3.0:1789403183.966454:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789403183.966543:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10426:1876325050680448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403183.966715:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.966751:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680448 00000100:00100000:3.0:1789403183.966761:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680448 00000100:00100000:3.0:1789403183.966788:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789403183.966793:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10426:x1876325050680448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403183.966869:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:10426:x1876325050680448:12345-0@lo:502:llog_process_th.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.966875:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789403183.966914:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.966926:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10426:1876325050680448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403183.966942:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403183.966945:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403183.966946:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789403183.966950:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789403183.975002:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789403183.975049:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789403183.975073:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.975089:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403183.975101:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789403183.975104:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a27b560000 from 4 10000000:01000000:2.0:1789403183.975107:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403183.975154:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.975163:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.975177:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403183.975208:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403183.975291:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403183.975361:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.975436:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680576 00000100:00100000:3.0:1789403183.975448:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680576 00000100:00100000:3.0:1789403183.975507:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789403183.975518:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050680576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403183.975535:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403183.975550:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c59 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.975579:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.975714:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.975723:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185600, rc 0) 00000100:00100000:3.0:1789403183.975770:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050680576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.975785:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789403183.975857:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403183.975873:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.975883:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403183.975954:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.975984:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.976000:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.976014:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680704 00000100:00100000:3.0:1789403183.976017:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680704 00000100:00100000:3.0:1789403183.976041:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789403183.976048:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050680704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.976243:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050680704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.976251:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789403183.976287:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.976316:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.976358:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.976374:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.976385:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680832 00000100:00100000:3.0:1789403183.976410:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680832 00000100:00100000:3.0:1789403183.976432:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789403183.976444:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050680832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.976522:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050680832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.976529:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789403183.976565:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050680832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403183.977746:0:10429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10429:1876325050680960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403183.977816:0:10429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403183.977859:0:10429:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bd2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403183.977906:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050680960 00000100:00100000:2.0:1789403183.977914:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050680960 00000100:00100000:2.0:1789403183.977956:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789403183.977965:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10429:x1876325050680960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403183.978215:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10429:x1876325050680960:12345-0@lo:502:llog_process_th.0 Request processed in 251us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403183.978223:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789403183.981541:0:10429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10429:1876325050680960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403183.981608:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403183.981621:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403183.981623:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789403183.981631:0:10429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a27b560000 00000020:00000080:1.0:1789403183.981634:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789403183.985299:0:10429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10429:1876325050681088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403183.985432:0:10429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403183.985501:0:10429:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.987109:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681088 00000100:00100000:3.0:1789403183.987126:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681088 00000100:00100000:3.0:1789403183.987199:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789403183.987211:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10429:x1876325050681088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403183.987426:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:10429:x1876325050681088:12345-0@lo:502:llog_process_th.0 Request processed in 216us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.987434:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789403183.987510:0:10429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10429:1876325050681088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789403183.987556:0:10429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403183.987565:0:10429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403183.987568:0:10429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789403183.987573:0:10429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789403183.987654:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789403183.987677:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789403183.987689:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.987701:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403183.987713:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789403183.987715:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b11800 from 4 10000000:01000000:2.0:1789403183.987719:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403183.987753:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.987761:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.987782:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403183.987808:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.990805:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.990864:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403183.991172:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681216 00000100:00100000:2.0:1789403183.991184:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681216 00000100:00100000:2.0:1789403183.991248:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789403183.991259:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050681216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403183.991279:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403183.991301:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c67 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.991336:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.991348:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403183.991359:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946800, rc 0) 00000100:00100000:2.0:1789403183.991434:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050681216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403183.991441:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789403183.991449:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403183.991468:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403183.991478:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403183.991572:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.991696:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.991727:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c5280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403183.995433:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681344 00000100:00100000:2.0:1789403183.995453:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681344 00000100:00100000:2.0:1789403183.995521:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789403183.995533:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050681344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403183.995744:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050681344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403183.995760:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789403183.995806:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.995977:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.996029:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403183.996145:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c5280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403183.996161:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681472 00000100:00100000:3.0:1789403183.996166:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681472 00000100:00100000:3.0:1789403183.996192:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789403183.996198:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050681472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403183.996276:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050681472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403183.996282:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789403183.996320:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403184.000251:0:10432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10432:1876325050681600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403184.000363:0:10432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403184.000434:0:10432:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403184.002306:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681600 00000100:00100000:0.0:1789403184.002324:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681600 00000100:00100000:0.0:1789403184.002408:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789403184.002420:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10432:x1876325050681600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403184.003754:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10432:x1876325050681600:12345-0@lo:502:llog_process_th.0 Request processed in 1329us (3385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403184.003766:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789403184.008786:0:10432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10432:1876325050681600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403184.010096:0:10432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403184.010115:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403184.010119:0:10432:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789403184.010128:0:10432:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a281b11800 00000020:00000080:3.0:1789403184.010132:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789403184.010263:0:10432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10432:1876325050681728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403184.010876:0:10432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403184.010938:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681728 00000100:00100000:3.0:1789403184.010949:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681728 00000100:00100000:3.0:1789403184.011014:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789403184.011025:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10432:x1876325050681728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403184.011197:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:10432:x1876325050681728:12345-0@lo:502:llog_process_th.0 Request processed in 172us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403184.011206:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789403184.011280:0:10432:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c5280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403184.011322:0:10432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10432:1876325050681728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403184.011379:0:10432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403184.011409:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403184.011411:0:10432:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789403184.011417:0:10432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789403184.011812:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789403184.011850:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789403184.011863:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.011878:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403184.011889:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789403184.011892:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a244ea0000 from 4 10000000:01000000:2.0:1789403184.011895:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403184.011931:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.011939:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.011951:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403184.011974:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403184.012021:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403184.012049:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad4180 going to sleep for 11 seconds 00000100:00100000:2.0:1789403184.012073:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681856 00000100:00100000:2.0:1789403184.012080:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681856 00000100:00100000:2.0:1789403184.012119:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789403184.012129:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050681856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403184.012142:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403184.012158:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760c75 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.012189:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.012203:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.012213:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946400, rc 0) 00000100:00100000:2.0:1789403184.012259:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050681856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403184.012268:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789403184.012300:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403184.012321:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403184.012334:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403184.013119:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403184.013169:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403184.013204:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c5280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403184.013255:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050681984 00000100:00100000:1.0:1789403184.013270:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050681984 00000100:00100000:1.0:1789403184.013315:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789403184.013325:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050681984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403184.013515:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050681984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.013523:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789403184.013559:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050681984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403184.013607:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050682112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403184.013652:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403184.013677:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c5280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403184.014011:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682112 00000100:00100000:1.0:1789403184.014017:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682112 00000100:00100000:1.0:1789403184.014054:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789403184.014062:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050682112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403184.014165:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050682112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.014172:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789403184.014198:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050682112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403184.017653:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10434:1876325050682240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403184.017756:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403184.017809:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403184.017865:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682240 00000100:00100000:1.0:1789403184.017876:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682240 00000100:00100000:1.0:1789403184.017946:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789403184.017959:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:10434:x1876325050682240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403184.018360:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:10434:x1876325050682240:12345-0@lo:502:llog_process_th.0 Request processed in 402us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.018370:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789403184.018428:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10434:1876325050682240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789403184.018630:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403184.018644:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403184.018648:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789403184.018658:0:10434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a244ea0000 00000020:00000080:2.0:1789403184.018661:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789403184.019147:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10434:1876325050682368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403184.019223:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403184.019523:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403184.019638:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682368 00000100:00100000:1.0:1789403184.019646:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682368 00000100:00100000:1.0:1789403184.019695:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789403184.019705:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:10434:x1876325050682368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403184.019834:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:10434:x1876325050682368:12345-0@lo:502:llog_process_th.0 Request processed in 121us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.019855:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789403184.020281:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:10434:1876325050682368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789403184.020315:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403184.020323:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403184.020325:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789403184.020330:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789403184.020617:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789403184.020651:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403184.020665:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403184.020681:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403184.268984:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403184.269091:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037376 00000100:00100000:1.0:1789403184.269105:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037376 00000100:00100000:2.0:1789403184.269461:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 269 00000100:00100000:2.0:1789403184.269477:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+9:6162:x1876325038037376:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403184.269502:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403184.269526:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128642 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.269564:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.269578:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403184.269589:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946000, rc 0) 00000100:00100000:2.0:1789403184.269708:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038037376:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 236us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403184.269716:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 269 00000100:00100000:3.0:1789403184.276677:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403184.276871:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037504 00000100:00100000:1.0:1789403184.276886:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037504 00000100:00100000:1.0:1789403184.277124:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 270 00000100:00100000:1.0:1789403184.277137:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038037504:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403184.277322:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038037504:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 188us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.277331:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 270 00000100:00100000:0.0:1789403184.281226:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403184.281357:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037632 00000100:00100000:1.0:1789403184.281370:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037632 00000100:00100000:1.0:1789403184.281550:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 271 00000100:00100000:1.0:1789403184.281562:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038037632:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403184.281736:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:6162:x1876325038037632:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 175us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.281743:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 271 00000100:00100000:0.0:1789403184.288015:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403184.288374:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037760 00000100:00100000:1.0:1789403184.288435:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037760 00000100:00100000:1.0:1789403184.288502:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 272 00000100:00100000:1.0:1789403184.288512:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6706:x1876325038037760:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403184.288687:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:6706:x1876325038037760:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 176us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.288695:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 272 00000100:00100000:0.0:1789403184.305193:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403184.307268:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038037888 00000100:00100000:1.0:1789403184.307290:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038037888 00000100:00100000:1.0:1789403184.307558:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 273 00000100:00100000:1.0:1789403184.307571:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:6706:x1876325038037888:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403184.307767:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:6706:x1876325038037888:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 199us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403184.307776:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 273 00010000:00010000:1.0:1789403184.626310:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403185.649759:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403185.907133:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050682496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403185.907201:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403185.907267:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682496 00000100:00100000:3.0:1789403185.907273:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682496 00000100:00100000:3.0:1789403185.907331:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403185.907339:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050682496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403185.907367:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403185.907481:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050682496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403185.907489:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789403185.907531:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143595880 x1876325050682496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403185.907547:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050682496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403185.907891:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403185.907901:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050682624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789403185.907923:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403185.907931:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403185.907946:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682624 00000100:00100000:3.0:1789403185.907950:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682624 00000100:00080000:1.0:1789403185.907969:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403185.907982:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403185.907988:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050682624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403185.908003:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403185.908090:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050682624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403185.908097:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789403185.911443:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7b100 x1876325050682624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403185.911474:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050682624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403186.257075:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403186.257116:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403186.257140:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403186.257160:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403186.257181:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403186.257214:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038272 00000100:00100000:1.0:1789403186.257223:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038272 00000100:00100000:1.0:1789403186.257287:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038144 00000100:00100000:1.0:1789403186.257290:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038144 00000100:00100000:1.0:1789403186.257315:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1789403186.257325:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038272:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403186.257331:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038528 00000100:00100000:3.0:1789403186.257338:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038528 00000100:00100000:3.0:1789403186.257374:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038400 00000100:00100000:3.0:1789403186.257378:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038400 00000100:00100000:1.0:1789403186.257420:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038272:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403186.257429:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1789403186.257445:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1789403186.257451:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038038144:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403186.257474:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038038144:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403186.257480:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:3.0:1789403186.257541:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403186.257549:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038528:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403186.257584:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038528:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403186.257601:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403186.257617:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1789403186.257624:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038400:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:1.0:1789403186.257642:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403186.257648:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038400:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00080000:1.0:1789403186.257649:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403186.257654:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403186.257658:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00080000:1.0:1789403186.257658:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403186.257747:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038016 00000100:00100000:0.0:1789403186.257752:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038016 00000100:00100000:0.0:1789403186.257785:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 274 00000100:00100000:0.0:1789403186.257792:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038038016:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403186.257831:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038038016:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 40us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403186.257838:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 274 00000100:00100000:2.0:1789403186.417546:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050682752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403186.417615:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403186.417687:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682752 00000100:00100000:2.0:1789403186.417694:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682752 00000100:00100000:2.0:1789403186.417743:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789403186.417752:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050682752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403186.417785:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403186.417841:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050682752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403186.417848:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789403186.417904:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050682752:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403186.674541:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403187.442626:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050682880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403187.442708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.442788:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050682880 00000100:00100000:3.0:1789403187.442807:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050682880 00000100:00100000:3.0:1789403187.442851:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403187.442860:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050682880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403187.442895:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403187.442941:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050682880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403187.442948:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403187.442991:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050682880:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403187.700483:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403187.953608:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050683008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403187.953681:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.953912:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050683520:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.953939:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.953959:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050684032:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.953980:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.954006:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050684544:0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.954122:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683520 00000100:00100000:0.0:1789403187.954129:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683520 00000100:00100000:0.0:1789403187.954184:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789403187.954192:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050683520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.954241:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050683520:12345-0@lo:400:kworker.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403187.954248:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789403187.954293:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.954339:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050683520:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.954354:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789403187.954360:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050683136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403187.954383:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403187.954490:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684032 00000100:00100000:0.0:1789403187.954494:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684032 00000100:00100000:0.0:1789403187.954527:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684544 00000100:00100000:0.0:1789403187.954530:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684544 00000100:00100000:0.0:1789403187.954548:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403187.954554:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050684032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.954598:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050684032:12345-0@lo:400:kworker.0 Request processed in 44us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403187.954603:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403187.954615:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403187.954621:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050684544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.954644:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050684544:12345-0@lo:400:kworker.0 Request processed in 24us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403187.954648:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789403187.954662:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403187.954666:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403187.954865:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050683648:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.954891:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.954908:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050684160:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.954927:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.954948:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050684672:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.954965:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789403187.954984:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369b480 x1876325050684032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403187.954994:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050684032:0@lo:400:kworker.0 00010000:00080000:3.0:1789403187.955003:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143747800 x1876325050684544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403187.955010:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050684544:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955109:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050683264:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.955167:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050683776:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955187:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.955204:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050684288:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955232:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.955249:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789403187.955255:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050683392:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955275:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.955289:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050683904:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955307:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.955321:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050684416:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.955339:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403187.955365:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683008 00000100:00100000:3.0:1789403187.955369:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683008 00000100:00100000:0.0:1789403187.955666:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683648 00000100:00100000:0.0:1789403187.955670:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683648 00000100:00100000:0.0:1789403187.955698:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789403187.955773:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684160 00000100:00100000:0.0:1789403187.955776:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050683648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403187.955777:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684160 00000100:00100000:1.0:1789403187.955818:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684672 00000100:00100000:1.0:1789403187.955821:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684672 00000100:00100000:0.0:1789403187.955829:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050683648:12345-0@lo:400:kworker.0 Request processed in 125us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403187.955835:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403187.955841:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050684160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.955844:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789403187.955863:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683776 00000100:00100000:0.0:1789403187.955867:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683776 00000100:00100000:1.0:1789403187.955872:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050684160:12345-0@lo:400:kworker.0 Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403187.955878:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789403187.955882:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684288 00000100:00100000:0.0:1789403187.955884:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684288 00000100:00100000:1.0:1789403187.955887:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789403187.955894:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683392 00000100:00100000:0.0:1789403187.955896:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683392 00000100:00100000:1.0:1789403187.955898:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050684672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.955904:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683904 00000100:00100000:0.0:1789403187.955906:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683904 00000100:00100000:0.0:1789403187.955916:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684416 00000100:00100000:0.0:1789403187.955919:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684416 00000100:00100000:1.0:1789403187.955923:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050684672:12345-0@lo:400:kworker.0 Request processed in 26us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403187.955928:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789403187.955930:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789403187.955935:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050683776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403187.955981:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050683776:12345-0@lo:400:kworker.0 Request processed in 46us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403187.955988:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789403187.955999:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789403187.956006:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050684288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956100:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683136 00000100:00100000:3.0:1789403187.956104:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683136 00000100:00100000:3.0:1789403187.956122:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403187.956128:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050683008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403187.956149:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403187.956215:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050683008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403187.956220:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403187.956232:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403187.956238:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050683136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403187.956247:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403187.956270:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050683136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403187.956275:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403187.956300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050683264 00000100:00100000:3.0:1789403187.956304:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050683264 00000100:00100000:3.0:1789403187.956337:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789403187.956343:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050683264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956380:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050683264:12345-0@lo:400:kworker.0 Request processed in 36us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403187.956380:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050683776:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956386:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789403187.956419:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050684288:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956437:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789403187.956437:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050683264:0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956444:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050683392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956481:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050683392:12345-0@lo:400:kworker.0 Request processed in 37us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403187.956486:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789403187.956498:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403187.956503:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050683904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956528:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050683904:12345-0@lo:400:kworker.0 Request processed in 26us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403187.956533:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403187.956555:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403187.956569:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050684416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403187.956597:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050684416:12345-0@lo:400:kworker.0 Request processed in 29us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403187.956602:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789403187.957053:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050683392:0@lo:400:kworker.0 00010000:00080000:1.0:1789403187.957065:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a300 x1876325050683904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403187.957076:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050683904:0@lo:400:kworker.0 00010000:00080000:1.0:1789403187.957085:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143699500 x1876325050684416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403187.957093:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050684416:0@lo:400:kworker.0 00000100:00080000:1.0:1789403187.963585:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403187.963596:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403187.963599:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403187.963603:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789403187.965692:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050683136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403187.965732:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050683136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403187.965747:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050683648:0@lo:400:kworker.0 00010000:00080000:1.0:1789403187.965778:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369b100 x1876325050684160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403187.965789:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050684160:0@lo:400:kworker.0 00010000:00080000:1.0:1789403187.965813:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143746a00 x1876325050684672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403187.965822:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050684672:0@lo:400:kworker.0 00010000:00080000:1.0:1789403187.965834:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143595880 x1876325050683008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403187.965847:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050683008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403187.966628:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050684288:12345-0@lo:400:kworker.0 Request processed in 10616us (11389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403187.966641:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1789403188.721738:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789403188.856274:0:10678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789403189.745821:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403190.770867:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403191.025567:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403191.025611:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050684800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403191.025682:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403191.025744:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684800 00000100:00100000:1.0:1789403191.025751:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684800 00000100:00100000:1.0:1789403191.025819:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789403191.025829:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050684800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403191.025860:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403191.025903:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050684800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403191.025910:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789403191.025931:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789403191.026138:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f100 x1876325050684800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403191.026157:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050684800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403191.026619:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403191.026635:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050684928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403191.026671:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403191.026726:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050684928 00000100:00100000:2.0:1789403191.026732:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050684928 00000100:00100000:2.0:1789403191.026790:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403191.026797:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050684928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403191.026809:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403191.026849:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050684928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403191.026855:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789403191.026886:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a277b72300 x1876325050684928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403191.026900:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050684928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789403191.026956:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403191.380164:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403191.380279:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038656 00000100:00100000:3.0:1789403191.380289:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038656 00000100:00100000:3.0:1789403191.380486:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 276 00000100:00100000:3.0:1789403191.380504:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038038656:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403191.380659:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038038656:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 157us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403191.380668:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 276 00000100:00100000:3.0:1789403191.380738:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403191.380861:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403191.380885:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403191.380908:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403191.380978:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038784 00000100:00100000:3.0:1789403191.380982:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038784 00000100:00100000:3.0:1789403191.381021:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038038912 00000100:00100000:3.0:1789403191.381024:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038038912 00000100:00100000:3.0:1789403191.381046:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:3.0:1789403191.381053:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038038784:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403191.381087:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038038784:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403191.381095:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:3.0:1789403191.381108:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:3.0:1789403191.381114:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038912:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403191.381139:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038038912:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403191.381145:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:3.0:1789403191.381163:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039040 00000100:00100000:3.0:1789403191.381180:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039040 00000100:00100000:3.0:1789403191.381206:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039168 00000100:00100000:3.0:1789403191.381209:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039168 00000100:00100000:3.0:1789403191.381230:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1789403191.381237:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038039040:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403191.381263:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038039040:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403191.381268:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1789403191.381280:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403191.381285:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038039168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403191.381309:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038039168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403191.381315:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00080000:3.0:1789403191.381336:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403191.381340:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403191.381342:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403191.381344:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403191.541466:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050685056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403191.541836:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403191.542257:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685056 00000100:00100000:0.0:1789403191.542266:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685056 00000100:00100000:0.0:1789403191.542313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789403191.542323:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050685056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789403191.542357:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789403191.547330:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050685056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4997us (5770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403191.547345:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789403191.549151:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050685056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789403191.796789:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403192.569813:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050685184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403192.569892:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403192.570009:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685184 00000100:00100000:1.0:1789403192.570017:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685184 00000100:00100000:1.0:1789403192.570073:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789403192.570083:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050685184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403192.570116:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789403192.570175:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050685184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403192.570181:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789403192.570432:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050685184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789403192.821033:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403193.073700:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050685440:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.073776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.073850:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050685952:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.073874:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.073897:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050686464:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.073918:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.073941:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789403193.073947:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050685312:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.073972:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.073992:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050685824:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074014:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074030:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050686336:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074052:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074070:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050686848:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074089:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074113:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050685568:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074134:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074151:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050686080:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074169:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074203:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050686592:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074229:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074242:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789403193.074248:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050685696:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074274:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074292:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050686208:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074328:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074371:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050686720:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074419:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403193.074452:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685440 00000100:00100000:2.0:1789403193.074459:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685440 00000100:00100000:2.0:1789403193.074495:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685952 00000100:00100000:2.0:1789403193.074498:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685952 00000100:00100000:2.0:1789403193.074521:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686464 00000100:00100000:2.0:1789403193.074524:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686464 00000100:00100000:2.0:1789403193.074535:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686080 00000100:00100000:2.0:1789403193.074537:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686080 00000100:00100000:2.0:1789403193.074548:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686592 00000100:00100000:2.0:1789403193.074550:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686592 00000100:00100000:2.0:1789403193.074560:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685696 00000100:00100000:2.0:1789403193.074562:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685696 00000100:00100000:2.0:1789403193.074576:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789403193.074584:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050685440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074635:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050685440:12345-0@lo:400:kworker.0 Request processed in 51us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.074642:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789403193.074660:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789403193.074666:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050685952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074693:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050685952:12345-0@lo:400:kworker.0 Request processed in 27us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.074699:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789403193.074709:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789403193.074715:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050686464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074739:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050686464:12345-0@lo:400:kworker.0 Request processed in 24us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.074763:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789403193.074776:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789403193.074783:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050686080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074814:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050686080:12345-0@lo:400:kworker.0 Request processed in 32us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.074820:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789403193.074831:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789403193.074837:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050686592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074862:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050686592:12345-0@lo:400:kworker.0 Request processed in 25us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.074867:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789403193.074877:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789403193.074883:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050685696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074906:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050685696:12345-0@lo:400:kworker.0 Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.074911:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789403193.074935:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685312 00000100:00100000:2.0:1789403193.074939:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685312 00000100:00100000:2.0:1789403193.074965:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789403193.074971:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050685312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.074999:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050685312:12345-0@lo:400:kworker.0 Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075005:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789403193.075030:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685824 00000100:00100000:2.0:1789403193.075033:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685824 00000100:00100000:2.0:1789403193.075057:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050685568 00000100:00100000:2.0:1789403193.075060:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050685568 00000100:00100000:2.0:1789403193.075071:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789403193.075076:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050685824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075106:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050685824:12345-0@lo:400:kworker.0 Request processed in 30us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075112:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789403193.075122:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789403193.075128:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050685568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075166:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050685568:12345-0@lo:400:kworker.0 Request processed in 38us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075173:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789403193.075191:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686336 00000100:00100000:2.0:1789403193.075194:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686336 00000100:00100000:2.0:1789403193.075211:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686848 00000100:00100000:2.0:1789403193.075214:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686848 00000100:00100000:2.0:1789403193.075223:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686208 00000100:00100000:2.0:1789403193.075226:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686208 00000100:00100000:2.0:1789403193.075234:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686720 00000100:00100000:2.0:1789403193.075236:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686720 00000100:00100000:2.0:1789403193.075249:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403193.075254:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050686336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075282:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050686336:12345-0@lo:400:kworker.0 Request processed in 28us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075288:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403193.075299:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403193.075305:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050686848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075329:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050686848:12345-0@lo:400:kworker.0 Request processed in 25us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075341:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403193.075352:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403193.075358:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050686208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075383:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050686208:12345-0@lo:400:kworker.0 Request processed in 26us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075410:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403193.075419:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789403193.075425:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050686720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075447:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050686720:12345-0@lo:400:kworker.0 Request processed in 23us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403193.075452:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789403193.075610:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403193.075614:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403193.075616:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403193.075618:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403193.075647:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050685696:0@lo:400:kworker.0 00010000:00080000:2.0:1789403193.075661:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143531180 x1876325050686208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.075671:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050686208:0@lo:400:kworker.0 00010000:00080000:2.0:1789403193.075682:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143533b80 x1876325050686720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.075688:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050686720:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075697:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050685568:0@lo:400:kworker.0 00010000:00080000:2.0:1789403193.075705:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143531c00 x1876325050686080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.075720:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050686080:0@lo:400:kworker.0 00010000:00080000:2.0:1789403193.075731:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143531500 x1876325050686592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.075740:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050686592:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075791:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050685312:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075801:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050685824:0@lo:400:kworker.0 00010000:00080000:2.0:1789403193.075809:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143533800 x1876325050686336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.075817:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050686336:0@lo:400:kworker.0 00010000:00080000:2.0:1789403193.075825:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143533480 x1876325050686848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.075831:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050686848:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075841:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050685440:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075849:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050685952:0@lo:400:kworker.0 00000100:00100000:2.0:1789403193.075857:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050686464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403193.080310:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403193.080333:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050686976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403193.080583:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403193.081030:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050686976 00000100:00100000:3.0:1789403193.081040:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050686976 00000100:00100000:3.0:1789403193.081095:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403193.081105:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050686976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403193.081143:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403193.081193:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050686976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403193.081201:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789403193.082970:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437d9f80 x1876325050686976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403193.082994:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050686976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403193.087593:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403193.087617:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050687104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403193.087920:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403193.095973:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687104 00000100:00100000:3.0:1789403193.095988:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687104 00000100:00100000:1.0:1789403193.096661:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789403193.096680:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050687104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403193.096707:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403193.096804:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050687104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (8884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403193.096811:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789403193.097026:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143745500 x1876325050687104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403193.097048:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050687104:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789403193.541925:0:10921:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing yml_node 00010000:00010000:3.0:1789403193.843286:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403194.865820:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403195.889631:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403196.146063:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403196.146088:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050687232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403196.146205:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403196.146405:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687232 00000100:00100000:1.0:1789403196.146413:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687232 00000100:00100000:1.0:1789403196.146478:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789403196.146489:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050687232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403196.146541:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403196.146606:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050687232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403196.146614:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789403196.146652:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2c380 x1876325050687232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403196.146672:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050687232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403196.146958:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789403196.146994:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403196.149072:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050687360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403196.149151:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403196.152920:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687360 00000100:00100000:3.0:1789403196.152943:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687360 00000100:00100000:3.0:1789403196.153031:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403196.153041:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050687360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403196.153065:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403196.153152:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050687360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403196.153158:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789403196.153407:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403196.153482:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143747480 x1876325050687360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403196.153503:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050687360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403196.496367:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403196.496449:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403196.496532:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039680 00000100:00100000:1.0:1789403196.496541:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039680 00000100:00100000:1.0:1789403196.496600:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039808 00000100:00100000:1.0:1789403196.496603:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039808 00000100:00100000:1.0:1789403196.496629:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403196.496639:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2386:x1876325038039680:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1789403196.496676:0:8416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b95 00000100:00080000:1.0:1789403196.496685:0:8416:0:(import.c:65:import_set_state_nolock()) ffff90a1427a0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403196.496741:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789403196.496933:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+2:2386:x1876325038039680:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 294us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403196.496941:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403196.496956:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403196.496963:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2386:x1876325038039808:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:1.0:1789403196.496976:0:8416:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b9c 00000100:00080000:1.0:1789403196.496982:0:8416:0:(import.c:65:import_set_state_nolock()) ffff90a141a3e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403196.497005:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789403196.497086:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+2:2386:x1876325038039808:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 123us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403196.497092:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:1.0:1789403196.497128:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403196.497134:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403196.497519:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403196.497523:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403196.498206:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403196.498274:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403196.498308:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403196.498368:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039552 00000100:00100000:1.0:1789403196.498376:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039552 00000100:00100000:1.0:1789403196.498446:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039424 00000100:00100000:1.0:1789403196.498450:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039424 00000100:00100000:1.0:1789403196.498469:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1789403196.498477:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038039552:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403196.498527:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038039552:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 51us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403196.498534:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1789403196.498548:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:1.0:1789403196.498555:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038039424:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403196.498577:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038039424:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403196.498582:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00080000:2.0:1789403196.498699:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403196.498703:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403196.498841:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039296 00000100:00100000:3.0:1789403196.498846:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039296 00000100:00100000:3.0:1789403196.498878:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 278 00000100:00100000:3.0:1789403196.498886:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038039296:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403196.498912:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038039296:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403196.498933:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 278 00000100:00100000:1.0:1789403196.657687:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403196.657712:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050687488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403196.657817:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403196.657968:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687488 00000100:00100000:3.0:1789403196.657978:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687488 00000100:00100000:3.0:1789403196.658035:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789403196.658045:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050687488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403196.658080:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403196.658151:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050687488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403196.658157:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789403196.658296:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050687488:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403196.913811:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403197.683314:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403197.683346:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050687616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403197.683450:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403197.683571:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687616 00000100:00100000:3.0:1789403197.683580:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687616 00000100:00100000:3.0:1789403197.683628:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789403197.683637:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050687616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403197.683669:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403197.683717:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050687616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403197.683735:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789403197.683777:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050687616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403197.937598:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789403197.961810:0:11105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1789403198.193697:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050687744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403198.193806:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.193942:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687744 00000100:00100000:2.0:1789403198.193951:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687744 00000100:00080000:3.0:1789403198.194886:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403198.195901:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050687872:0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.195995:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.196051:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050688384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.196087:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.196131:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050688896:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.196137:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688384 00000100:00100000:2.0:1789403198.196152:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688384 00000100:00100000:1.0:1789403198.196161:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.196196:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789403198.196205:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050688000:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.196217:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789403198.196232:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050688384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.196242:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.196268:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050688512:0@lo:400:kworker.0 00000100:00100000:3.0:1789403198.196383:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050688128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.197166:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.197204:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050689024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.197229:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.197259:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050689408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403198.197286:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403198.197484:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050687872 00000100:00100000:1.0:1789403198.197494:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050687872 00000100:00100000:1.0:1789403198.197550:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789403198.197559:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050687872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198246:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050688384:12345-0@lo:400:kworker.0 Request processed in 2012us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.198259:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789403198.198351:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050688384:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198440:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050688256:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198494:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.198520:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050688768:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198543:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.198562:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050689280:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198601:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.198634:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688000 00000100:00100000:2.0:1789403198.198641:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688000 00000100:00100000:2.0:1789403198.198670:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688512 00000100:00100000:2.0:1789403198.198673:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688512 00000100:00100000:2.0:1789403198.198695:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689024 00000100:00100000:2.0:1789403198.198698:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689024 00000100:00100000:2.0:1789403198.198710:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688256 00000100:00100000:2.0:1789403198.198712:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688256 00000100:00100000:2.0:1789403198.198737:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789403198.198745:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050688000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198800:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050688000:12345-0@lo:400:kworker.0 Request processed in 56us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.198807:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789403198.198819:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789403198.198824:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050688512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198848:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050688512:12345-0@lo:400:kworker.0 Request processed in 24us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.198854:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789403198.198863:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789403198.198868:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050689024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198889:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050689024:12345-0@lo:400:kworker.0 Request processed in 21us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.198895:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789403198.198903:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789403198.198908:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050688256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.198930:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050688256:12345-0@lo:400:kworker.0 Request processed in 22us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.198943:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789403198.198961:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688896 00000100:00100000:2.0:1789403198.198965:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688896 00000100:00100000:2.0:1789403198.198988:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688768 00000100:00100000:2.0:1789403198.198991:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688768 00000100:00100000:2.0:1789403198.199003:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689280 00000100:00100000:2.0:1789403198.199006:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689280 00000100:00100000:2.0:1789403198.199019:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403198.199025:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050688896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199056:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050688896:12345-0@lo:400:kworker.0 Request processed in 31us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.199062:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403198.199073:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403198.199078:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050688768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199102:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050688768:12345-0@lo:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.199108:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403198.199118:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789403198.199124:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050689280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199148:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050689280:12345-0@lo:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.199153:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789403198.199188:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050688256:0@lo:400:kworker.0 00010000:00080000:2.0:1789403198.199200:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143699500 x1876325050688768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403198.199210:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050688768:0@lo:400:kworker.0 00010000:00080000:2.0:1789403198.199229:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143699f80 x1876325050689280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403198.199236:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050689280:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199270:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050688000:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199282:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050688512:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199291:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050689024:0@lo:400:kworker.0 00010000:00080000:2.0:1789403198.199302:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a300 x1876325050688896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403198.199311:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050688896:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.199334:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689408 00000100:00100000:2.0:1789403198.199338:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689408 00000100:00100000:2.0:1789403198.199356:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789403198.199362:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050687744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789403198.199382:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403198.199445:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050687744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.199451:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789403198.199462:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789403198.199468:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050689408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403198.199476:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403198.199503:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050689408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.199509:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789403198.199543:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f5500 x1876325050687744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403198.199557:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050687744:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789403198.199581:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437daa00 x1876325050689408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403198.199593:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050689408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403198.202218:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050687872:12345-0@lo:400:kworker.0 Request processed in 4645us (6210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403198.202238:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789403198.203347:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050687872:0@lo:400:kworker.0 00000100:00080000:2.0:1789403198.205456:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403198.205466:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403198.205469:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403198.208030:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.208098:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688128 00000100:00100000:3.0:1789403198.208103:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050688640:0@lo:400:kworker.0 00000100:00100000:2.0:1789403198.208116:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688128 00000100:00100000:3.0:1789403198.208178:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.208186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789403198.208199:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050688128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403198.208265:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050689152:0@lo:400:kworker.0 00000100:00100000:3.0:1789403198.208315:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403198.209633:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050688128:12345-0@lo:400:kworker.0 Request processed in 1429us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403198.209780:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789403198.211410:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050688640 00000100:00100000:1.0:1789403198.211430:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050688640 00000100:00100000:1.0:1789403198.211505:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689152 00000100:00100000:1.0:1789403198.211510:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689152 00000100:00100000:1.0:1789403198.211543:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789403198.211555:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050688640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.211670:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050688640:12345-0@lo:400:kworker.0 Request processed in 118us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403198.211692:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789403198.211723:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789403198.211731:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050689152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403198.211764:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050689152:12345-0@lo:400:kworker.0 Request processed in 34us (3449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403198.211769:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789403198.211872:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789403198.212122:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a680 x1876325050689152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403198.212142:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050689152:0@lo:400:kworker.0 00000100:00100000:3.0:1789403198.212188:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050688128:0@lo:400:kworker.0 00010000:00080000:2.0:1789403198.217822:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050688640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403198.217845:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050688640:0@lo:400:kworker.0 00010000:00010000:1.0:1789403198.962845:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403199.986762:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789403200.681819:0:11202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1789403201.018530:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403201.266489:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403201.266517:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050689536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403201.266605:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403201.266828:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689536 00000100:00100000:2.0:1789403201.266839:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689536 00000100:00100000:2.0:1789403201.266915:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789403201.266927:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050689536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403201.266966:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403201.267037:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050689536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403201.267044:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789403201.267315:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789403201.267359:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3f100 x1876325050689536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403201.267380:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050689536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403201.270653:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050689664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403201.270760:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403201.270975:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689664 00000100:00100000:1.0:1789403201.270987:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689664 00000100:00100000:1.0:1789403201.271057:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403201.271067:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050689664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403201.271096:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403201.271147:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050689664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403201.271155:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789403201.272830:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403201.272899:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649c00 x1876325050689664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403201.272930:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050689664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403201.611194:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403201.611244:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403201.611278:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038039936 00000100:00100000:0.0:1789403201.611290:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038039936 00000100:00100000:0.0:1789403201.611348:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 280 00000100:00100000:0.0:1789403201.611360:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038039936:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403201.611469:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038039936:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403201.611477:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 280 00000100:00100000:3.0:1789403201.612140:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040064 00000100:00100000:3.0:1789403201.612148:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040064 00000100:00100000:3.0:1789403201.612200:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:3.0:1789403201.612208:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038040064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403201.612260:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038040064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 53us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403201.612267:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00080000:3.0:1789403201.612285:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403201.625124:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403201.625203:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040192 00000100:00100000:0.0:1789403201.625216:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040192 00000100:00100000:0.0:1789403201.625302:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:0.0:1789403201.625315:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038040192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403201.625450:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038040192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 138us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403201.625474:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00080000:3.0:1789403201.625937:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403201.779511:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403201.779539:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050689792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403201.779629:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403201.779715:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689792 00000100:00100000:2.0:1789403201.779725:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689792 00000100:00100000:2.0:1789403201.779779:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789403201.779789:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050689792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403201.779832:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403201.779883:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050689792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403201.779890:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789403201.779945:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050689792:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1789403201.785493:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:0.0:1789403201.785506:0:8409:0:(genops.c:885:class_export_put()) final put ffff90a1427a3800/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:2.0:1789403201.787941:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1427a3800/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-OST0000 00000020:00000080:2.0:1789403201.788014:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1427a0800 for lustre-OST0000 00000001:00100000:0.0:1789403201.789009:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:0.0:1789403201.789019:0:9495:0:(genops.c:885:class_export_put()) final put ffff90a27c339000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:2.0:1789403201.789153:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c339000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-OST0001 00000020:00000080:2.0:1789403201.789197:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a141a3e800 for lustre-OST0001 00010000:00010000:2.0:1789403202.036855:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403202.801884:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050689920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403202.801982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403202.802132:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050689920 00000100:00100000:0.0:1789403202.802143:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050689920 00000100:00100000:0.0:1789403202.802207:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403202.802218:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050689920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403202.802260:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403202.802321:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050689920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403202.802328:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789403202.802533:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050689920:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403203.059804:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403203.319090:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050690176:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319159:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319223:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050690688:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319244:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319267:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050691200:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319285:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319300:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050691712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403203.319321:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319347:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789403203.319353:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050690304:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319374:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319416:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050690816:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319451:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319467:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050691328:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319485:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319494:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050691840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403203.319512:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319539:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050690432:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.319559:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.319569:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050690944:0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.319817:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050690048:0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.319851:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403203.319874:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050690560:0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.319905:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403203.319921:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050691072:0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.319942:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403203.319958:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050691584:0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.319977:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403203.320011:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690176 00000100:00100000:2.0:1789403203.320018:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690176 00000100:00100000:2.0:1789403203.320054:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690688 00000100:00100000:2.0:1789403203.320057:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690688 00000100:00100000:2.0:1789403203.320078:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691200 00000100:00100000:2.0:1789403203.320081:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691200 00000100:00100000:2.0:1789403203.320094:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690816 00000100:00100000:2.0:1789403203.320096:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690816 00000100:00100000:2.0:1789403203.320105:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691328 00000100:00100000:2.0:1789403203.320107:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691328 00000100:00100000:2.0:1789403203.320117:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690432 00000100:00100000:2.0:1789403203.320119:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690432 00000100:00100000:2.0:1789403203.320132:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789403203.320139:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050690176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.320188:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050690176:12345-0@lo:400:kworker.0 Request processed in 49us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.320195:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789403203.320211:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789403203.320218:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050690688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.320243:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050690688:12345-0@lo:400:kworker.0 Request processed in 26us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.320248:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789403203.320258:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789403203.320270:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050691200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.320299:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050691200:12345-0@lo:400:kworker.0 Request processed in 29us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.320305:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789403203.320316:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789403203.320321:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050690816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.320345:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050690816:12345-0@lo:400:kworker.0 Request processed in 24us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.320350:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789403203.320358:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789403203.320362:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050691328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.320380:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050691328:12345-0@lo:400:kworker.0 Request processed in 19us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.320385:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789403203.320409:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403203.320414:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050690432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403203.320436:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050690432:12345-0@lo:400:kworker.0 Request processed in 22us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.320440:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403203.320457:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690048 00000100:00100000:2.0:1789403203.320460:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690048 00000100:00100000:2.0:1789403203.320482:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789403203.320487:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050690048:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789403203.320716:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403203.320721:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403203.320731:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691072 00000100:00100000:1.0:1789403203.320735:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691072 00000100:00100000:1.0:1789403203.320764:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691584 00000100:00100000:1.0:1789403203.320766:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691584 00000100:00100000:1.0:1789403203.320783:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789403203.320790:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050691072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.320827:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050691072:12345-0@lo:400:kworker.0 Request processed in 38us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.320833:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789403203.320845:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789403203.320851:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050691584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.320877:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050691584:12345-0@lo:400:kworker.0 Request processed in 26us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.320882:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789403203.320900:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690304 00000100:00100000:1.0:1789403203.320904:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690304 00000100:00100000:1.0:1789403203.320921:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690560 00000100:00100000:1.0:1789403203.320923:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690560 00000100:00100000:1.0:1789403203.320933:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789403203.320939:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050690304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.320969:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050690304:12345-0@lo:400:kworker.0 Request processed in 30us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.320975:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789403203.320987:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403203.321001:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050690560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.321028:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050690560:12345-0@lo:400:kworker.0 Request processed in 28us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.321034:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789403203.321049:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403203.321052:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403203.321081:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050690304:0@lo:400:kworker.0 00010000:00080000:1.0:1789403203.321095:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f4700 x1876325050690816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403203.321106:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050690816:0@lo:400:kworker.0 00010000:00080000:1.0:1789403203.321115:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050691328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403203.321123:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050691328:0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.321132:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050690176:0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.321141:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050690688:0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.321149:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050691200:0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.321202:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691712 00000100:00100000:1.0:1789403203.321206:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691712 00000100:00100000:1.0:1789403203.321227:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691840 00000100:00100000:1.0:1789403203.321230:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691840 00000100:00100000:1.0:1789403203.321248:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403203.321255:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050691712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403203.321276:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403203.321312:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050691712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.321324:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403203.321336:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789403203.321340:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050691840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403203.321352:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403203.321377:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050691840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.321381:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789403203.321433:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789403203.321449:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143746d80 x1876325050691840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403203.321463:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050691840:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789403203.321473:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649880 x1876325050691712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403203.321482:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050691712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403203.321541:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050690560:0@lo:400:kworker.0 00010000:00080000:1.0:1789403203.321550:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f5c00 x1876325050691072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403203.321557:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050691072:0@lo:400:kworker.0 00010000:00080000:1.0:1789403203.321566:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a680 x1876325050691584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403203.322808:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050690048:12345-0@lo:400:kworker.0 Request processed in 2315us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403203.322829:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789403203.323074:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050691584:0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.323108:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050690048:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.323288:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.323328:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050691456:0@lo:400:kworker.0 00000100:00100000:3.0:1789403203.323353:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403203.323513:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050690432:0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.324815:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050690944 00000100:00100000:1.0:1789403203.324826:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050690944 00000100:00100000:1.0:1789403203.324885:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691456 00000100:00100000:1.0:1789403203.324889:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691456 00000100:00100000:1.0:1789403203.324910:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789403203.324919:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050690944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.324985:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050690944:12345-0@lo:400:kworker.0 Request processed in 68us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.324991:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789403203.325005:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403203.325011:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050691456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403203.325037:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050691456:12345-0@lo:400:kworker.0 Request processed in 26us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403203.325042:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789403203.325119:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403203.325152:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f7100 x1876325050690944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403203.325174:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050690944:0@lo:400:kworker.0 00010000:00080000:3.0:1789403203.325187:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369aa00 x1876325050691456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403203.325195:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050691456:0@lo:400:kworker.0 00000001:02000400:0.0:1789403203.332895:0:11300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:3.0:1789403204.083223:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403205.105859:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789403205.130282:0:11348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 14 12:26:43 EDT 2026 00010000:00010000:3.0:1789403206.136721:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403206.385935:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403206.385963:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050691968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403206.386048:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403206.386121:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050691968 00000100:00100000:1.0:1789403206.386132:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050691968 00000100:00100000:1.0:1789403206.386196:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789403206.386205:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050691968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403206.386241:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403206.386291:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050691968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403206.386299:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789403206.386323:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789403206.386367:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649880 x1876325050691968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403206.387573:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050691968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403206.388180:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050692096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403206.388251:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403206.388447:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692096 00000100:00100000:0.0:1789403206.388457:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692096 00000100:00100000:0.0:1789403206.388522:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403206.388532:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050692096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403206.388556:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789403206.388777:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403206.388871:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050692096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 340us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403206.388880:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789403206.389074:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a4a80 x1876325050692096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403206.389096:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050692096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403206.729323:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403206.729372:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403206.729446:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403206.729478:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040576 00000100:00100000:3.0:1789403206.729490:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040576 00000100:00100000:3.0:1789403206.729557:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040448 00000100:00100000:3.0:1789403206.729561:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040448 00000100:00100000:3.0:1789403206.729765:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1789403206.729779:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038040576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403206.729876:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038040576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 100us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403206.729884:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1789403206.729907:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:3.0:1789403206.729914:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038040448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403206.729940:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038040448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403206.729958:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00080000:3.0:1789403206.729978:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403206.729982:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403206.730345:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040320 00000100:00100000:1.0:1789403206.730352:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040320 00000100:00100000:1.0:1789403206.732552:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 282 00000100:00100000:1.0:1789403206.732578:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:2388:x1876325038040320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403206.732687:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+10:2388:x1876325038040320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 120us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403206.732696:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 282 00000100:00100000:1.0:1789403206.904666:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403206.904702:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050692224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403206.904789:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403206.904873:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692224 00000100:00100000:1.0:1789403206.904882:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692224 00000100:00100000:1.0:1789403206.904946:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789403206.904958:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050692224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403206.905018:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403206.905217:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050692224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 259us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403206.905236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789403206.906780:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050692224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789403207.154559:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403207.921907:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403207.921931:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050692352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403207.922016:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403207.922092:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692352 00000100:00100000:1.0:1789403207.922100:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692352 00000100:00100000:1.0:1789403207.922147:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789403207.922156:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050692352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403207.922192:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789403207.922243:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050692352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403207.922250:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789403207.922301:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050692352:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789403208.177538:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403208.437620:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050692608:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.437705:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.437758:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050693120:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.437781:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.437804:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050693632:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.437837:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.437865:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789403208.437872:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050692480:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.437908:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.437935:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050692992:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.437960:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.437982:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050693504:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438006:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438023:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694016:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438078:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403208.438185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438218:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050692736:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438237:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438253:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050693248:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438271:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403208.438306:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694144 00000100:00100000:3.0:1789403208.438313:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694144 00000100:00100000:3.0:1789403208.438368:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789403208.438376:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403208.438415:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403208.438460:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403208.438466:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789403208.438486:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403208.438646:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050693760:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438681:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438693:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789403208.438697:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050692864:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438712:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438720:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050693376:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438735:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438746:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050693888:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.438761:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403208.438910:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692608 00000100:00100000:2.0:1789403208.438914:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692608 00000100:00100000:2.0:1789403208.438935:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693120 00000100:00100000:2.0:1789403208.438937:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693120 00000100:00100000:2.0:1789403208.438950:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693632 00000100:00100000:2.0:1789403208.438952:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693632 00000100:00100000:2.0:1789403208.438962:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693248 00000100:00100000:2.0:1789403208.438963:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693248 00000100:00100000:2.0:1789403208.438972:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693760 00000100:00100000:2.0:1789403208.438974:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693760 00000100:00100000:2.0:1789403208.438982:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692864 00000100:00100000:2.0:1789403208.438984:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692864 00000100:00100000:2.0:1789403208.438993:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789403208.438999:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050692608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.439028:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050692608:12345-0@lo:400:kworker.0 Request processed in 30us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.439034:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789403208.439045:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789403208.439050:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050693120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.439069:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050693120:12345-0@lo:400:kworker.0 Request processed in 19us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.439080:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789403208.439089:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789403208.439094:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050693632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.439114:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050693632:12345-0@lo:400:kworker.0 Request processed in 21us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.439119:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789403208.439127:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789403208.439132:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050693248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.439156:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050693248:12345-0@lo:400:kworker.0 Request processed in 23us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.439161:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789403208.439169:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789403208.439174:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050693760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.439195:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050693760:12345-0@lo:400:kworker.0 Request processed in 21us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.439200:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789403208.439210:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789403208.439217:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050692864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.439241:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050692864:12345-0@lo:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.439246:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789403208.439273:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692480 00000100:00100000:2.0:1789403208.439278:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692480 00000100:00100000:2.0:1789403208.439305:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789403208.440906:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050692480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.441004:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050692480:12345-0@lo:400:kworker.0 Request processed in 1692us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.441012:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789403208.441066:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692992 00000100:00100000:2.0:1789403208.441074:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692992 00000100:00100000:2.0:1789403208.441100:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050692736 00000100:00100000:2.0:1789403208.441103:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050692736 00000100:00100000:2.0:1789403208.441117:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789403208.441124:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050692992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.441173:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050692992:12345-0@lo:400:kworker.0 Request processed in 49us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.441179:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789403208.441191:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789403208.441197:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050692736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.441226:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050692736:12345-0@lo:400:kworker.0 Request processed in 29us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.441231:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789403208.441250:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693504 00000100:00100000:2.0:1789403208.441254:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693504 00000100:00100000:2.0:1789403208.441274:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694016 00000100:00100000:2.0:1789403208.441277:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694016 00000100:00100000:2.0:1789403208.441287:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693376 00000100:00100000:2.0:1789403208.441289:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693376 00000100:00100000:2.0:1789403208.441302:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050693888 00000100:00100000:2.0:1789403208.441304:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050693888 00000100:00100000:3.0:1789403208.442509:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789403208.442527:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050693504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.442583:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050693504:12345-0@lo:400:kworker.0 Request processed in 65us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403208.442588:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789403208.442706:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789403208.442714:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.442746:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694016:12345-0@lo:400:kworker.0 Request processed in 35us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403208.442762:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403208.445486:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403208.445505:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050693376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.445593:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050693376:12345-0@lo:400:kworker.0 Request processed in 96us (6855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403208.445600:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403208.445675:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403208.445684:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050693888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.445715:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050693888:12345-0@lo:400:kworker.0 Request processed in 33us (6953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403208.445730:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1789403208.445752:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403208.445756:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403208.445760:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403208.445763:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403208.446500:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050692864:0@lo:400:kworker.0 00010000:00080000:2.0:1789403208.446516:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050693376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403208.446528:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050693376:0@lo:400:kworker.0 00010000:00080000:2.0:1789403208.446539:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281911180 x1876325050693888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403208.446547:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050693888:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.446559:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050692736:0@lo:400:kworker.0 00010000:00080000:2.0:1789403208.446571:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a680 x1876325050693248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403208.446579:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050693248:0@lo:400:kworker.0 00010000:00080000:2.0:1789403208.446594:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281910000 x1876325050693760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403208.446603:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050693760:0@lo:400:kworker.0 00010000:00080000:3.0:1789403208.446622:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a648e00 x1876325050694144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403208.446657:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403208.446674:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050692480:0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.446688:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050692992:0@lo:400:kworker.0 00010000:00080000:3.0:1789403208.446775:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3f100 x1876325050693504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403208.446786:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050693504:0@lo:400:kworker.0 00010000:00080000:3.0:1789403208.446800:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281912680 x1876325050694016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403208.446807:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694016:0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.446820:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050692608:0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.446830:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050693120:0@lo:400:kworker.0 00000100:00100000:3.0:1789403208.446839:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050693632:0@lo:400:kworker.0 00000100:00100000:2.0:1789403208.447604:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050694272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403208.447673:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403208.447741:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694272 00000100:00100000:1.0:1789403208.447748:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694272 00000100:00100000:1.0:1789403208.447787:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789403208.447796:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050694272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403208.447816:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403208.460051:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050694272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12247us (12369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403208.460065:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789403208.460166:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a648e00 x1876325050694272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403208.460191:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050694272:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789403209.201957:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403210.231416:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403211.253155:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403211.508750:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050694400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403211.508853:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403211.519602:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694400 00000100:00100000:0.0:1789403211.519624:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694400 00000100:00100000:0.0:1789403211.519695:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403211.519706:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050694400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403211.519752:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403211.519837:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050694400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (10984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403211.519844:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789403211.519866:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403211.519882:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403211.519899:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694528:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789403211.519915:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a5f80 x1876325050694400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403211.519938:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050694400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403211.519945:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403211.520000:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694528 00000100:00100000:2.0:1789403211.520005:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694528 00000100:00100000:2.0:1789403211.520042:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789403211.520048:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403211.520059:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403211.520092:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403211.520099:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789403211.520131:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143744380 x1876325050694528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403211.520145:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789403211.520189:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403211.850097:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403211.850142:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403211.850174:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403211.850201:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040704 00000100:00100000:3.0:1789403211.850211:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040704 00000100:00100000:3.0:1789403211.850259:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 284 00000100:00100000:3.0:1789403211.850269:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038040704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403211.850339:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038040704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403211.850346:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 284 00000100:00100000:2.0:1789403211.850969:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040832 00000100:00100000:2.0:1789403211.850975:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040832 00000100:00100000:2.0:1789403211.851159:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038040960 00000100:00100000:2.0:1789403211.851163:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038040960 00000100:00100000:2.0:1789403211.851267:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:2.0:1789403211.851277:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038040832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403211.851326:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038040832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 51us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403211.851333:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:2.0:1789403211.851348:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1789403211.851355:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038040960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403211.851411:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038040960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403211.851418:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00080000:3.0:1789403211.851676:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403211.851681:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403212.019619:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403212.019704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403212.020212:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694656 00000100:00100000:2.0:1789403212.020221:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694656 00000100:00100000:2.0:1789403212.020269:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789403212.020278:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403212.020312:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403212.021916:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050694656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1631us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403212.021929:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789403212.022031:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050694656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789403212.275702:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403213.043011:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403213.043040:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050694784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403213.043130:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403213.043211:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694784 00000100:00100000:1.0:1789403213.043221:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694784 00000100:00100000:1.0:1789403213.043283:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789403213.043294:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050694784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403213.043338:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789403213.043416:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050694784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403213.043423:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789403213.043478:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050694784:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403213.315951:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403213.554076:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050694912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403213.554193:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403213.554283:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050695552:0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.554317:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403213.554346:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050694912 00000100:00100000:1.0:1789403213.554351:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050696064:0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.554357:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050694912 00000100:00100000:1.0:1789403213.554385:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403213.554550:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789403213.554560:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050695168:0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.554572:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403213.554586:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050694912:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403213.554616:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789403213.554643:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403213.554646:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050695680:0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.554682:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403213.554735:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050696192:0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.554737:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050694912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.554753:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789403213.554778:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403213.554785:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403213.554824:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695552 00010000:00080000:1.0:1789403213.554828:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649c00 x1876325050694912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403213.554831:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695552 00000100:00100000:1.0:1789403213.554862:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050694912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403213.554868:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696064 00000100:00100000:0.0:1789403213.554874:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696064 00000100:00100000:0.0:1789403213.554906:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695168 00000100:00100000:0.0:1789403213.554908:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695168 00000100:00100000:0.0:1789403213.554918:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695680 00000100:00100000:0.0:1789403213.554921:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695680 00000100:00100000:0.0:1789403213.554932:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696192 00000100:00100000:0.0:1789403213.554935:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696192 00000100:00100000:0.0:1789403213.554969:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789403213.554974:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050695552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.555029:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050695552:12345-0@lo:400:kworker.0 Request processed in 54us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.555034:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789403213.555047:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789403213.555052:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050696064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.555077:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050696064:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.555082:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789403213.555093:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789403213.555098:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050695168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.555123:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050695168:12345-0@lo:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.555128:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789403213.555139:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789403213.555144:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050695680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.555169:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050695680:12345-0@lo:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.555174:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789403213.555185:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789403213.555191:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050696192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.555335:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050695168:0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.555351:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050696192:12345-0@lo:400:kworker.0 Request processed in 158us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.555362:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1789403213.555368:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14369a680 x1876325050695680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403213.555380:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050695680:0@lo:400:kworker.0 00010000:00080000:1.0:1789403213.555415:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f78e00 x1876325050696192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403213.555423:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050696192:0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.555435:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050695552:0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.555445:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050696064:0@lo:400:kworker.0 00000100:00080000:0.0:1789403213.555496:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403213.555499:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403213.555666:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050695040:0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.555705:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403213.555743:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050695424:0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.555770:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403213.555799:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050695936:0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.555821:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403213.555843:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050696448:0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.555863:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695040 00000100:00100000:2.0:1789403213.555865:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403213.555877:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695040 00000100:00100000:2.0:1789403213.555905:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789403213.555916:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050695296:0@lo:400:kworker.0 00000100:00100000:1.0:1789403213.555954:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789403213.555962:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403213.555975:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050695040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.555999:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050695808:0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.556113:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695424 00000100:00100000:0.0:1789403213.556120:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695424 00000100:00100000:0.0:1789403213.556156:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789403213.556164:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050695424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.560236:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403213.560290:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050696320:0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.560326:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403213.560385:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695296 00000100:00100000:2.0:1789403213.560409:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695296 00000100:00100000:2.0:1789403213.560466:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789403213.560476:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050695296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.560499:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050695424:12345-0@lo:400:kworker.0 Request processed in 4335us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.560509:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789403213.560520:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050695296:12345-0@lo:400:kworker.0 Request processed in 46us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403213.560525:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789403213.560551:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695936 00000100:00100000:2.0:1789403213.560554:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695936 00000100:00100000:0.0:1789403213.560558:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050695296:0@lo:400:kworker.0 00000100:00100000:0.0:1789403213.560571:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050695424:0@lo:400:kworker.0 00000100:00080000:0.0:1789403213.560593:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403213.560800:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696448 00000100:00100000:2.0:1789403213.560804:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696448 00000100:00100000:2.0:1789403213.560829:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050695808 00000100:00100000:2.0:1789403213.560831:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050695808 00000100:00100000:2.0:1789403213.560842:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696320 00000100:00100000:2.0:1789403213.560844:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696320 00000100:00100000:2.0:1789403213.560857:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789403213.560864:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050695936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.560912:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050695936:12345-0@lo:400:kworker.0 Request processed in 49us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403213.560918:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789403213.560931:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789403213.560938:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050696448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.561210:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050696448:12345-0@lo:400:kworker.0 Request processed in 272us (5344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403213.561234:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789403213.561249:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789403213.561258:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050695808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.561292:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050695808:12345-0@lo:400:kworker.0 Request processed in 38us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403213.561297:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789403213.561309:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789403213.561315:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050696320:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789403213.561334:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143699500 x1876325050695808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403213.561345:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050696320:12345-0@lo:400:kworker.0 Request processed in 31us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.561347:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050695808:0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.561350:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789403213.561359:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79880 x1876325050696320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403213.561369:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050696320:0@lo:400:kworker.0 00000100:00080000:2.0:1789403213.561381:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403213.561382:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050695936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403213.561385:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403213.561543:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050695936:0@lo:400:kworker.0 00010000:00080000:0.0:1789403213.561555:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79180 x1876325050696448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403213.561562:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050696448:0@lo:400:kworker.0 00000100:00100000:2.0:1789403213.561849:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403213.561862:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050696576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403213.561889:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403213.562009:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696576 00000100:00100000:0.0:1789403213.562121:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696576 00000100:00100000:0.0:1789403213.562158:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789403213.562168:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050696576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403213.562185:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403213.562233:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050696576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403213.562240:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789403213.562282:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143745880 x1876325050696576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403213.562298:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050696576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403213.566526:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050695040:12345-0@lo:400:kworker.0 Request processed in 10542us (10804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403213.566547:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789403213.566557:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050695040:0@lo:400:kworker.0 00010000:00010000:3.0:1789403214.321565:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403215.352549:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403216.373208:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403216.625856:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050696704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403216.625940:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403216.626102:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696704 00000100:00100000:3.0:1789403216.626110:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696704 00000100:00100000:3.0:1789403216.626170:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789403216.626179:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050696704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403216.626206:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403216.626246:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050696704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403216.626252:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789403216.626426:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403216.626453:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a5c00 x1876325050696704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403216.626472:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050696704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403216.633548:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050696832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403216.633631:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403216.633838:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696832 00000100:00100000:1.0:1789403216.633846:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696832 00000100:00080000:0.0:1789403216.634007:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403216.634047:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789403216.634058:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050696832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403216.634080:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403216.634174:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050696832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403216.634181:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789403216.639584:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f5f80 x1876325050696832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403216.639615:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050696832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403216.970041:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403216.970084:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403216.970145:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041344 00000100:00100000:2.0:1789403216.970155:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403216.970157:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041344 00000100:00100000:1.0:1789403216.970228:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041216 00000100:00100000:1.0:1789403216.970233:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041216 00000100:00100000:0.0:1789403216.970283:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041088 00000100:00100000:0.0:1789403216.970288:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041088 00000100:00100000:3.0:1789403216.970304:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:3.0:1789403216.970318:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038041344:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403216.970322:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 286 00000100:00100000:0.0:1789403216.970334:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038041088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403216.970425:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038041344:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403216.970448:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00080000:2.0:1789403216.972878:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403216.972908:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403216.976541:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:1.0:1789403216.976558:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038041216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403216.976737:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:2390:x1876325038041088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 6402us (6701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403216.976771:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 286 00000100:00100000:1.0:1789403216.977036:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038041216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 483us (6879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403216.977044:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:1.0:1789403217.138111:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403217.138139:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050696960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403217.138227:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403217.138304:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050696960 00000100:00100000:1.0:1789403217.138314:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050696960 00000100:00100000:1.0:1789403217.138375:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403217.138528:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050696960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403217.138583:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403217.138639:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050696960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403217.138647:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403217.138782:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050696960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789403217.405785:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403218.162788:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403218.162817:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050697088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403218.162905:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403218.162983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697088 00000100:00100000:0.0:1789403218.162992:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697088 00000100:00100000:0.0:1789403218.163052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789403218.163064:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050697088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403218.163106:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403218.163160:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050697088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403218.163168:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789403218.163223:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050697088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403218.428815:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403218.673750:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403218.673782:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050697344:0@lo:400:kworker.0 00000100:00100000:3.0:1789403218.673871:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403218.673984:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697344 00000100:00100000:3.0:1789403218.673994:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697344 00000100:00100000:2.0:1789403218.674120:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403218.674133:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050697216:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674175:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.674243:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050697472:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674268:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.674316:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050697600:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674344:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.674375:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697600 00000100:00100000:2.0:1789403218.674379:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697600 00000100:00100000:2.0:1789403218.674457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789403218.674467:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050697600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674549:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050697600:12345-0@lo:400:kworker.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.674557:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789403218.674622:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050697600:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674657:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403218.674664:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050697728:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674688:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.674714:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697472 00000100:00100000:2.0:1789403218.674718:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697472 00000100:00100000:2.0:1789403218.674741:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697728 00000100:00100000:2.0:1789403218.674744:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697728 00000100:00100000:2.0:1789403218.674771:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789403218.674778:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050697472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674813:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050697472:12345-0@lo:400:kworker.0 Request processed in 36us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.674836:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789403218.674850:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789403218.674856:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050697728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674885:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050697728:12345-0@lo:400:kworker.0 Request processed in 30us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.674890:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1789403218.674905:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403218.674923:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050697728:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674943:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050697472:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674971:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403218.674978:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050697856:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.674999:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.675020:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697856 00000100:00100000:2.0:1789403218.675023:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697856 00000100:00100000:2.0:1789403218.675057:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403218.675062:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050697856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675093:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050697856:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.675099:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1789403218.675113:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789403218.675130:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143382680 x1876325050697856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403218.675143:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050697856:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675173:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050697984:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675203:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.675233:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697984 00000100:00100000:2.0:1789403218.675237:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697984 00000100:00100000:2.0:1789403218.675268:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789403218.675275:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050697984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675308:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050697984:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.675315:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789403218.675333:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403218.675349:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143382680 x1876325050697984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403218.675360:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050697984:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675419:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050698112:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675444:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.675472:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698112 00000100:00100000:2.0:1789403218.675476:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698112 00000100:00100000:2.0:1789403218.675506:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789403218.675512:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050698112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675545:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050698112:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.675551:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789403218.675581:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403218.675598:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143382680 x1876325050698112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403218.675608:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050698112:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675636:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403218.675651:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050698240:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675677:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.675698:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698240 00000100:00100000:2.0:1789403218.675702:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698240 00000100:00100000:2.0:1789403218.675724:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789403218.675729:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050698240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675760:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050698240:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.675766:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1789403218.675779:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403218.675794:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050698240:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675823:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403218.675830:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050698368:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675854:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.675876:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698368 00000100:00100000:2.0:1789403218.675879:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698368 00000100:00100000:2.0:1789403218.675901:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789403218.675908:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050698368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.675939:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050698368:12345-0@lo:400:kworker.0 Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.675945:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789403218.675957:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789403218.675971:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143382680 x1876325050698368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403218.675981:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050698368:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.676010:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050698496:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.676043:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.676066:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698496 00000100:00100000:2.0:1789403218.676070:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698496 00000100:00100000:2.0:1789403218.676093:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789403218.676099:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050698496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.676131:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050698496:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.676137:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789403218.676152:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789403218.676165:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143533100 x1876325050698496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403218.676174:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050698496:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.676205:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050698624:0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.676226:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403218.676246:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698624 00000100:00100000:2.0:1789403218.676249:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698624 00000100:00100000:2.0:1789403218.676271:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789403218.676276:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050698624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403218.676307:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050698624:12345-0@lo:400:kworker.0 Request processed in 30us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403218.676313:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789403218.676327:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789403218.676341:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143533100 x1876325050698624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403218.676350:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050698624:0@lo:400:kworker.0 00000100:00100000:3.0:1789403218.677075:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789403218.677090:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050697344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403218.677149:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050697344:12345-0@lo:400:kworker.0 Request processed in 64us (3278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403218.677155:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789403218.677193:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050697344:0@lo:400:kworker.0 00000100:00100000:1.0:1789403218.677788:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050698752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403218.677834:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403218.677881:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050697216 00000100:00100000:1.0:1789403218.677902:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050697216 00000100:00100000:1.0:1789403218.677940:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789403218.677958:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050697216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403218.678344:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403218.678355:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050698880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403218.678406:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403218.678458:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698752 00000100:00100000:0.0:1789403218.678463:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698752 00000100:00100000:0.0:1789403218.678512:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050698880 00000100:00100000:0.0:1789403218.678516:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050698880 00000100:00100000:0.0:1789403218.678531:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403218.678538:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050698752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403218.678574:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403218.678615:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050698752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403218.678623:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403218.678654:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789403218.678659:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050698880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403218.678670:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403218.678698:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050698880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403218.678704:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1789403218.678742:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143744000 x1876325050698880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403218.678760:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050698880:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789403218.678810:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143746680 x1876325050698752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403218.678822:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050698752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403218.679358:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050697216:12345-0@lo:400:kworker.0 Request processed in 1398us (5179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403218.679367:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789403218.679868:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050697216:0@lo:400:kworker.0 00010000:00010000:1.0:1789403219.441731:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403220.465947:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789403220.698130:0:11977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:26:59 (1789403219) === 00000100:00100000:3.0:1789403221.248754:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.249700:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041472 00000100:00100000:0.0:1789403221.249713:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041472 00000100:00100000:0.0:1789403221.249780:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 288 00000100:00100000:0.0:1789403221.249790:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+10:8716:x1876325038041472:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789403221.249807:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403221.249825:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b760c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128649 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403221.249858:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b760c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128649 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403221.249869:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b760c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128649 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403221.249897:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1000, rc 0) 00000100:00100000:0.0:1789403221.249966:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+11:8716:x1876325038041472:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 177us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.249972:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 288 00000100:00100000:3.0:1789403221.252441:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.253956:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041600 00000100:00100000:1.0:1789403221.253969:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041600 00000100:00100000:1.0:1789403221.254036:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 289 00000100:00100000:1.0:1789403221.254046:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:8716:x1876325038041600:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789403221.256456:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:8716:x1876325038041600:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 2400us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.256470:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 289 00000100:00100000:2.0:1789403221.289108:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.289296:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041728 00000100:00100000:1.0:1789403221.289306:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041728 00000100:00100000:1.0:1789403221.289362:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 290 00000100:00100000:1.0:1789403221.289372:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:8716:x1876325038041728:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789403221.289532:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:8716:x1876325038041728:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.289550:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 290 00000100:00100000:3.0:1789403221.303072:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.304447:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041856 00000100:00100000:1.0:1789403221.304460:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041856 00000100:00100000:1.0:1789403221.304530:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 291 00000100:00100000:1.0:1789403221.304550:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:8720:x1876325038041856:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403221.304889:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:8720:x1876325038041856:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 189us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.304897:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 291 00000100:00100000:3.0:1789403221.345791:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.346088:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038041984 00000100:00100000:0.0:1789403221.346104:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038041984 00000100:00100000:0.0:1789403221.346174:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 292 00000100:00100000:0.0:1789403221.346184:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+11:8720:x1876325038041984:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403221.346365:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+11:8720:x1876325038041984:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 182us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.346374:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 292 00000100:00100000:2.0:1789403221.361698:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.361974:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042112 00000100:00100000:1.0:1789403221.361991:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042112 00000100:00100000:1.0:1789403221.362061:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 293 00000100:00100000:1.0:1789403221.362073:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:8720:x1876325038042112:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403221.362240:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:8720:x1876325038042112:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 169us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.362259:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 293 00000100:00100000:3.0:1789403221.369706:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.370268:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042240 00000100:00100000:1.0:1789403221.370278:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042240 00000100:00100000:1.0:1789403221.370340:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 294 00000100:00100000:1.0:1789403221.370351:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:8716:x1876325038042240:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789403221.370367:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403221.370384:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b760c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12867a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403221.370445:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b760c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12867a expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403221.370455:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b760c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12867a expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403221.370485:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04a00, rc 0) 00000100:00100000:1.0:1789403221.370553:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:8716:x1876325038042240:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 204us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.370561:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 294 00000100:00100000:3.0:1789403221.389310:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.390365:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042368 00000100:00100000:0.0:1789403221.390378:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042368 00000100:00100000:0.0:1789403221.390468:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 295 00000100:00100000:0.0:1789403221.390478:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+12:8716:x1876325038042368:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789403221.390503:0:6492:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789403221.390527:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789403221.390531:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789403221.390535:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789403221.390538:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789403221.390550:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789403221.392709:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+12:8716:x1876325038042368:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 2221us (3398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.392721:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 295 00000100:00100000:3.0:1789403221.404177:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403221.404441:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042496 00000100:00100000:2.0:1789403221.404452:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042496 00000100:00100000:2.0:1789403221.404563:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 296 00000100:00100000:2.0:1789403221.404574:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:8716:x1876325038042496:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403221.404591:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403221.404606:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128681 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403221.404634:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403221.404646:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403221.404654:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27200, rc 0) 00000100:00100000:2.0:1789403221.404711:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:8716:x1876325038042496:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 140us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403221.404718:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 296 00000100:00100000:3.0:1789403221.406581:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.406669:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042624 00000100:00100000:0.0:1789403221.406692:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042624 00000100:00100000:0.0:1789403221.406898:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 297 00000100:00100000:0.0:1789403221.406909:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:8716:x1876325038042624:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403221.407059:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:8716:x1876325038042624:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 151us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.407066:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 297 00000100:00100000:3.0:1789403221.409332:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.409522:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042752 00000100:00100000:0.0:1789403221.409531:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042752 00000100:00100000:0.0:1789403221.409589:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 298 00000100:00100000:0.0:1789403221.409599:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:8716:x1876325038042752:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789403221.409746:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:8716:x1876325038042752:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 148us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.409754:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 298 00000100:00100000:3.0:1789403221.416529:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.417335:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038042880 00000100:00100000:1.0:1789403221.417347:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038042880 00000100:00100000:1.0:1789403221.417492:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 299 00000100:00100000:1.0:1789403221.417505:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:8724:x1876325038042880:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403221.417676:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:8724:x1876325038042880:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 173us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.417684:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 299 00000100:00100000:3.0:1789403221.421480:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403221.421866:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043008 00000100:00100000:2.0:1789403221.421878:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043008 00000100:00100000:2.0:1789403221.421948:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 300 00000100:00100000:2.0:1789403221.421959:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:8724:x1876325038043008:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789403221.422526:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:8724:x1876325038043008:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 565us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403221.422535:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 300 00000100:00100000:3.0:1789403221.436308:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403221.436349:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403221.436382:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403221.436442:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.437294:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043264 00000100:00100000:1.0:1789403221.437308:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043264 00000100:00100000:1.0:1789403221.437369:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043392 00000100:00100000:1.0:1789403221.437372:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043392 00000100:00100000:1.0:1789403221.437414:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043136 00000100:00100000:1.0:1789403221.437418:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043136 00000100:00100000:1.0:1789403221.437431:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043648 00000100:00100000:1.0:1789403221.437433:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043648 00000100:00100000:1.0:1789403221.437445:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1789403221.437455:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038043264:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403221.437532:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038043264:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 79us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.437550:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1789403221.437566:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:1.0:1789403221.437573:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038043392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403221.437626:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038043392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 53us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.437632:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:1.0:1789403221.437647:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403221.437651:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1876325038043136:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789403221.437674:0:6501:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e558fa5f-d909-4a9e-a611-b5e26918f0ce@192.168.203.43@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1789403221.437706:0:6501:0:(genops.c:1384:class_connect()) connect: client e558fa5f-d909-4a9e-a611-b5e26918f0ce, cookie 0x5fb08b1e5b760c9f 00000004:00100000:1.0:1789403221.437731:0:6501:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789403221.437884:0:6501:0:(import.c:65:import_set_state_nolock()) ffff90a277bdd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403221.437914:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2386:x1876325038043136:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 261us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.437920:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403221.437933:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1789403221.437937:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2386:x1876325038043648:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789403221.437952:0:6501:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e558fa5f-d909-4a9e-a611-b5e26918f0ce@192.168.203.43@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1789403221.437996:0:6501:0:(genops.c:1384:class_connect()) connect: client e558fa5f-d909-4a9e-a611-b5e26918f0ce, cookie 0x5fb08b1e5b760ca6 00000004:00100000:1.0:1789403221.438011:0:6501:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789403221.438068:0:6501:0:(import.c:65:import_set_state_nolock()) ffff90a277bdb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403221.438094:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2386:x1876325038043648:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 154us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.438101:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00080000:3.0:1789403221.438409:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403221.438414:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403221.447233:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403221.447427:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043520 00000100:00100000:2.0:1789403221.447449:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043520 00000100:00100000:2.0:1789403221.447519:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1789403221.447529:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:0:x1876325038043520:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789403221.447571:0:9061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403221.447667:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:0:x1876325038043520:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 139us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403221.447674:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00080000:3.0:1789403221.447736:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403221.455192:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.455696:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043904 00000100:00100000:0.0:1789403221.455707:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043904 00000100:00100000:0.0:1789403221.455776:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403221.455787:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038043904:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789403221.455818:0:6499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403221.455895:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038043904:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 109us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.455903:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1789403221.457147:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403221.457660:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038043776 00000100:00100000:2.0:1789403221.457669:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038043776 00000100:00100000:2.0:1789403221.457741:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1789403221.457751:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:0:x1876325038043776:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789403221.457785:0:9061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403221.457859:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:0:x1876325038043776:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 109us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403221.457867:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00080000:3.0:1789403221.458261:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403221.459134:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.459209:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044032 00000100:00100000:1.0:1789403221.459216:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044032 00000100:00100000:1.0:1789403221.459270:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1789403221.459294:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038044032:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789403221.459359:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038044032:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.459367:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403221.462347:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403221.462381:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403221.462447:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403221.462532:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044160 00000100:00100000:0.0:1789403221.462552:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044160 00000100:00100000:0.0:1789403221.462589:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044288 00000100:00100000:0.0:1789403221.462593:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044288 00000100:00100000:0.0:1789403221.462623:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1789403221.462631:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1876325038044160:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789403221.462680:0:8563:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e558fa5f-d909-4a9e-a611-b5e26918f0ce@192.168.203.43@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1789403221.462709:0:8563:0:(genops.c:1384:class_connect()) connect: client e558fa5f-d909-4a9e-a611-b5e26918f0ce, cookie 0x5fb08b1e5b760cad 00002000:00100000:0.0:1789403221.462732:0:8563:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e558fa5f-d909-4a9e-a611-b5e26918f0ce/ffff90a14371e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1789403221.462745:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00002000:00100000:0.0:1789403221.462748:0:8563:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789403221.462751:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1876325038044288:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789403221.462769:0:8415:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e558fa5f-d909-4a9e-a611-b5e26918f0ce@192.168.203.43@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1789403221.462783:0:8415:0:(genops.c:1384:class_connect()) connect: client e558fa5f-d909-4a9e-a611-b5e26918f0ce, cookie 0x5fb08b1e5b760cb4 00002000:00100000:3.0:1789403221.462789:0:8415:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e558fa5f-d909-4a9e-a611-b5e26918f0ce/ffff90a14368a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789403221.462798:0:8415:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789403221.462819:0:8563:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:3.0:1789403221.462832:0:8415:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789403221.462845:0:8415:0:(import.c:65:import_set_state_nolock()) ffff90a14368e000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789403221.462845:0:8563:0:(import.c:65:import_set_state_nolock()) ffff90a14371a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403221.462933:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044416 00000100:00100000:1.0:1789403221.462938:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044416 00000100:00100000:1.0:1789403221.462970:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1789403221.462977:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038044416:12345-192.168.203.43@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789403221.463039:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2386:x1876325038044160:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 407us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403221.463046:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1789403221.466534:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2386:x1876325038044288:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 3757us (4063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403221.466558:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1789403221.466786:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038044416:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 3621us (4259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.466796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1789403221.469603:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403221.469748:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044544 00000100:00100000:1.0:1789403221.469758:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044544 00000100:00100000:1.0:1789403221.469860:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1789403221.469872:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038044544:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789403221.469956:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789403221.470041:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:8716:x1876325038044544:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 170us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403221.470048:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00010000:00010000:2.0:1789403221.489561:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403221.745862:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050699008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403221.746021:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403221.746360:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050699136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403221.746426:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403221.746512:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699008 00000100:00100000:3.0:1789403221.746520:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699008 00000100:00100000:3.0:1789403221.746588:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699136 00000100:00100000:3.0:1789403221.746736:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699136 00000100:00100000:3.0:1789403221.746762:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403221.746773:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050699008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403221.746795:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403221.746845:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050699008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403221.746852:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403221.746868:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789403221.746874:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050699136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403221.746884:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403221.746909:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050699136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403221.746914:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789403221.747085:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a5c00 x1876325050699008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403221.747107:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050699008:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789403221.747834:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403221.747881:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f4a80 x1876325050699136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403221.747900:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050699136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403222.258106:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403222.258130:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050699264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403222.258199:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403222.258293:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699264 00000100:00100000:2.0:1789403222.258301:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699264 00000100:00100000:2.0:1789403222.258705:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789403222.258715:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050699264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403222.259140:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403222.259205:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050699264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 492us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403222.259213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789403222.259326:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050699264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789403222.516063:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403223.285273:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050699392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403223.285347:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.285719:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699392 00000100:00100000:0.0:1789403223.285728:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699392 00000100:00100000:0.0:1789403223.285770:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789403223.285779:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050699392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403223.285811:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403223.285866:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050699392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.285874:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789403223.286020:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050699392:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403223.537738:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403223.793868:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403223.793892:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050699520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403223.793960:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403223.794020:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699520 00000100:00100000:3.0:1789403223.794028:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699520 00000100:00100000:3.0:1789403223.794080:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789403223.794091:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050699520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403223.794120:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403223.794162:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050699520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403223.794183:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789403223.794228:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a5f80 x1876325050699520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403223.794247:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050699520:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789403223.794374:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403223.794671:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050699904:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.794702:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403223.794721:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050700416:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.794741:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403223.794759:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050700928:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.794777:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403223.794792:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789403223.794797:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050700032:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.794815:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403223.794831:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050700544:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.794853:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403223.794867:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050701056:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.794884:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403223.794913:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699904 00000100:00100000:2.0:1789403223.794918:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699904 00000100:00100000:2.0:1789403223.794941:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700416 00000100:00100000:2.0:1789403223.794944:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700416 00000100:00100000:2.0:1789403223.794961:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700928 00000100:00100000:2.0:1789403223.794964:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700928 00000100:00100000:2.0:1789403223.794973:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700032 00000100:00100000:2.0:1789403223.794975:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700032 00000100:00100000:2.0:1789403223.794987:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789403223.794993:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050699904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.795028:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050699904:12345-0@lo:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403223.795034:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789403223.795050:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789403223.795055:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050700416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.795080:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050700416:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403223.795085:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789403223.795095:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789403223.795101:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050700928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.795135:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050700928:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403223.795142:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789403223.795153:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789403223.795158:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050700032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.795248:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050700032:12345-0@lo:400:kworker.0 Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403223.795263:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1789403223.795284:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403223.795304:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050700032:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.795314:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050699904:0@lo:400:kworker.0 00010000:00080000:2.0:1789403223.795324:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e5180 x1876325050700416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403223.795333:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050700416:0@lo:400:kworker.0 00010000:00080000:2.0:1789403223.795343:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e7b80 x1876325050700928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403223.795349:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050700928:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.795659:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050699776:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.795693:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.795729:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050700288:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.795750:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.795767:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050700800:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.795796:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.795814:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789403223.795820:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050699648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403223.795840:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.795856:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050700160:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.795875:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.795891:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050700672:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.795908:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403223.795943:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700288 00000100:00100000:0.0:1789403223.795947:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700288 00000100:00100000:0.0:1789403223.795979:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700800 00000100:00100000:0.0:1789403223.795982:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700800 00000100:00100000:0.0:1789403223.795997:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789403223.796003:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050700288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796037:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050700288:12345-0@lo:400:kworker.0 Request processed in 34us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796042:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789403223.796054:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789403223.796060:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050700800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796086:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050700800:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796092:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789403223.796108:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700544 00000100:00100000:0.0:1789403223.796111:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700544 00000100:00100000:0.0:1789403223.796133:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701056 00000100:00100000:0.0:1789403223.796136:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701056 00000100:00100000:0.0:1789403223.796147:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700672 00000100:00100000:0.0:1789403223.796154:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700672 00000100:00100000:0.0:1789403223.796242:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403223.796250:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050700544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796301:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050700544:12345-0@lo:400:kworker.0 Request processed in 52us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796307:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403223.796318:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789403223.796323:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050701056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796346:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050701056:12345-0@lo:400:kworker.0 Request processed in 24us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796351:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789403223.796359:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789403223.796364:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050700672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796385:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050700672:12345-0@lo:400:kworker.0 Request processed in 21us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796413:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789403223.796432:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699648 00000100:00100000:0.0:1789403223.796435:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699648 00000100:00100000:0.0:1789403223.796455:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789403223.796461:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050699648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403223.796473:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403223.796499:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050699648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796504:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789403223.796529:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050700160 00000100:00100000:0.0:1789403223.796533:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050700160 00000100:00100000:0.0:1789403223.796557:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789403223.796569:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050700160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796599:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050700160:12345-0@lo:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403223.796605:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789403223.796643:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403223.796647:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403223.796649:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789403223.796671:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143530a80 x1876325050699648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403223.796688:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050699648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403223.796698:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050700160:0@lo:400:kworker.0 00010000:00080000:0.0:1789403223.796706:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e6a00 x1876325050700672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403223.796715:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050700672:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796724:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050700288:0@lo:400:kworker.0 00000100:00100000:0.0:1789403223.796731:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050700800:0@lo:400:kworker.0 00010000:00080000:0.0:1789403223.796774:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e7800 x1876325050700544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403223.796782:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050700544:0@lo:400:kworker.0 00010000:00080000:0.0:1789403223.796790:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e7480 x1876325050701056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403223.796797:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050701056:0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.798046:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050699776 00000100:00100000:2.0:1789403223.798060:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050699776 00000100:00100000:2.0:1789403223.798107:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789403223.798115:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050699776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403223.798202:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050699776:12345-0@lo:400:kworker.0 Request processed in 87us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403223.798208:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789403223.798288:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050699776:0@lo:400:kworker.0 00010000:00010000:3.0:1789403224.562068:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403225.585589:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403226.611529:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403226.699574:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403226.699619:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403226.699646:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403226.699769:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044672 00000100:00100000:1.0:1789403226.699780:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044672 00000100:00100000:1.0:1789403226.699831:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 302 00000100:00100000:1.0:1789403226.699841:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038044672:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403226.699926:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038044672:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 86us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403226.699934:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 302 00000100:00100000:2.0:1789403226.701787:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403226.701828:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403226.701964:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045440 00000100:00100000:1.0:1789403226.701973:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045440 00000100:00100000:1.0:1789403226.702036:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1789403226.702045:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045440:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403226.702118:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045440:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403226.702125:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00080000:1.0:1789403226.702159:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403226.703820:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044928 00000100:00100000:3.0:1789403226.703830:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044928 00000100:00100000:2.0:1789403226.703861:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403226.703876:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045184 00000100:00100000:3.0:1789403226.703879:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045184 00000100:00100000:3.0:1789403226.703893:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038044800 00000100:00100000:3.0:1789403226.703896:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038044800 00000100:00100000:3.0:1789403226.703910:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:3.0:1789403226.703919:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038044928:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403226.703966:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:3.0:1789403226.703972:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038044928:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 54us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403226.703975:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045184:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403226.703978:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:3.0:1789403226.703993:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:3.0:1789403226.703999:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038044800:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403226.704002:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045184:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403226.704008:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:3.0:1789403226.704019:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038044800:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 21us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403226.704025:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00080000:1.0:1789403226.704038:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403226.704041:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403226.707099:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403226.707174:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045312 00000100:00100000:0.0:1789403226.707195:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045312 00000100:00100000:1.0:1789403226.707554:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045056 00000100:00100000:1.0:1789403226.707559:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045056 00000100:00100000:0.0:1789403226.711342:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1789403226.711360:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045312:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403226.711483:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045312:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 129us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403226.711491:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:1.0:1789403226.717043:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:1.0:1789403226.717058:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045056:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403226.717899:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2387:x1876325038045056:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 838us (14033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403226.717909:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00080000:2.0:1789403226.719158:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403226.719167:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403226.866671:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050701184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403226.866741:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403226.866802:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050701312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403226.866830:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403226.866893:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701184 00000100:00100000:2.0:1789403226.866901:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701184 00000100:00100000:2.0:1789403226.866951:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701312 00000100:00100000:2.0:1789403226.866954:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701312 00000100:00100000:2.0:1789403226.866973:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789403226.866982:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050701184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403226.867014:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403226.867060:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050701184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403226.867068:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789403226.867088:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789403226.867095:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050701312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403226.867105:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403226.867128:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050701312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403226.867135:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789403226.867155:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403226.867184:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f4a80 x1876325050701184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403226.867202:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050701184:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789403226.867235:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e7480 x1876325050701312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403226.867247:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050701312:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1789403226.871274:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00100000:3.0:1789403226.871488:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00100000:2.0:1789403226.871620:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00100000:2.0:1789403226.873312:0:7431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000100:00100000:3.0:1789403227.377587:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403227.377610:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050701440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403227.377689:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403227.377747:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701440 00000100:00100000:1.0:1789403227.377755:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701440 00000100:00100000:1.0:1789403227.377805:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789403227.377815:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050701440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403227.377849:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403227.377914:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050701440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403227.377922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789403227.378744:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050701440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789403227.635479:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789403227.654014:0:12170:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1789403228.402019:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050701568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403228.402089:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403228.402264:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701568 00000100:00100000:0.0:1789403228.402273:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701568 00000100:00100000:0.0:1789403228.402321:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789403228.402330:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050701568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403228.402362:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403228.402438:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050701568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403228.402445:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789403228.403088:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050701568:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789403228.660678:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403228.914037:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403228.914057:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050701696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403228.914114:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403228.914125:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403228.914347:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050702208:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.914708:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.914738:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050702080:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.914740:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050702336:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.914787:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.914788:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.914817:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050702592:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.914988:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050702848:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.915032:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403228.915060:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789403228.915065:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050701952:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.915089:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403228.915109:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050702464:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.915137:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701696 00000100:00100000:2.0:1789403228.915144:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701696 00000100:00100000:2.0:1789403228.915185:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701824 00000100:00100000:2.0:1789403228.915188:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701824 00000100:00100000:2.0:1789403228.915202:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789403228.915209:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050701696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403228.915245:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403228.915281:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050701696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403228.915287:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789403228.915302:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403228.915306:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050701824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789403228.915314:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403228.915335:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050701824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403228.915341:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403228.915357:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702336 00000100:00100000:2.0:1789403228.915360:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702336 00000100:00100000:2.0:1789403228.915379:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789403228.915385:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050702336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.915444:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050702336:12345-0@lo:400:kworker.0 Request processed in 59us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403228.915451:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789403228.915465:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403228.915471:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050701952 00000100:00100000:2.0:1789403228.915475:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050701952 00010000:00080000:3.0:1789403228.915510:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a5c00 x1876325050701696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403228.915519:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789403228.915531:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050701696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403228.915532:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050701952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.915550:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050703104:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.915576:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050701952:12345-0@lo:400:kworker.0 Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.915582:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.915604:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403228.915610:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050702720:0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.915632:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.915660:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702080 00000100:00100000:2.0:1789403228.915665:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789403228.915666:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702080 00000100:00080000:2.0:1789403228.915698:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403228.915701:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702592 00000100:00100000:3.0:1789403228.915706:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702592 00000100:00100000:3.0:1789403228.915730:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703104 00000100:00080000:2.0:1789403228.915732:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403228.915733:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703104 00000100:00100000:2.0:1789403228.915750:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403228.915766:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050702976:0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.915786:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.915802:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702464 00000100:00100000:2.0:1789403228.915803:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050702336:0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.915815:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702464 00010000:00080000:2.0:1789403228.915816:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e5c00 x1876325050701824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403228.915831:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403228.915847:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702976 00000100:00100000:3.0:1789403228.915851:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702976 00000100:00100000:2.0:1789403228.915854:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050701952:0@lo:400:kworker.0 00000100:00080000:2.0:1789403228.915874:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403228.915877:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789403228.915885:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050702080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.915930:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050702080:12345-0@lo:400:kworker.0 Request processed in 46us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.915936:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789403228.915949:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789403228.915955:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050702592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.915981:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050702592:12345-0@lo:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.915987:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789403228.915997:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789403228.916003:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050703104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.916026:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050703104:12345-0@lo:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.916031:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789403228.916042:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789403228.916048:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050702464:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789403228.916067:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79180 x1876325050703104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403228.916079:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050703104:0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.916085:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050702464:12345-0@lo:400:kworker.0 Request processed in 35us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.916093:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789403228.916096:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050702080:0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.916110:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00010000:00080000:2.0:1789403228.916113:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143747800 x1876325050702592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403228.916122:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050702976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403228.916130:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050702592:0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.916161:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050702976:12345-0@lo:400:kworker.0 Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.916209:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789403228.916238:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702848 00000100:00100000:3.0:1789403228.916243:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702848 00000100:00100000:0.0:1789403228.916247:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702720 00000100:00100000:0.0:1789403228.916254:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702720 00000100:00100000:3.0:1789403228.916282:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789403228.916292:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050702848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403228.916294:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789403228.916307:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050702720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.916333:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050702848:12345-0@lo:400:kworker.0 Request processed in 42us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.916340:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789403228.916362:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050702720:12345-0@lo:400:kworker.0 Request processed in 57us (728us total) trans 0 rc 0/0 00000100:00080000:3.0:1789403228.916370:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403228.916371:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789403228.916412:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050702464:0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.916429:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050702976:0@lo:400:kworker.0 00010000:00080000:3.0:1789403228.916451:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143530a80 x1876325050702848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1789403228.916451:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143744000 x1876325050702720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403228.916492:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050702848:0@lo:400:kworker.0 00000100:00100000:0.0:1789403228.916492:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050702720:0@lo:400:kworker.0 00000100:00100000:1.0:1789403228.917142:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403228.917244:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050702208 00000100:00100000:3.0:1789403228.917250:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050702208 00000100:00100000:3.0:1789403228.917327:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789403228.917335:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050702208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403228.917415:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050702208:12345-0@lo:400:kworker.0 Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403228.917422:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789403228.917496:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050702208:0@lo:400:kworker.0 00010000:00010000:2.0:1789403229.681544:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403230.709809:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403231.733644:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403231.821346:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403231.821379:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403231.821427:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403231.821444:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403231.821459:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403231.821489:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403231.821509:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403231.821991:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045824 00000100:00100000:0.0:1789403231.822001:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045824 00000100:00100000:0.0:1789403231.822060:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046080 00000100:00100000:0.0:1789403231.822064:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046080 00000100:00100000:0.0:1789403231.822078:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045696 00000100:00100000:0.0:1789403231.822080:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045696 00000100:00100000:0.0:1789403231.822090:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045952 00000100:00100000:0.0:1789403231.822092:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045952 00000100:00100000:0.0:1789403231.822109:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:0.0:1789403231.822119:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038045824:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403231.822193:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038045824:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 75us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403231.822200:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:0.0:1789403231.822218:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1789403231.822224:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038046080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403231.822246:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038046080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403231.822251:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1789403231.822261:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1789403231.822266:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038045696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403231.822283:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038045696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 18us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403231.822289:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1789403231.822297:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:0.0:1789403231.822302:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038045952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403231.822331:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038045952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 29us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403231.822337:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00080000:2.0:1789403231.823314:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403231.823320:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403231.823527:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038045568 00000100:00100000:3.0:1789403231.823535:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038045568 00000100:00100000:3.0:1789403231.823639:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 304 00000100:00100000:3.0:1789403231.823776:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038045568:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403231.823913:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038045568:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 209us (2519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403231.823922:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 304 00000100:00100000:3.0:1789403231.823959:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046336 00000100:00100000:3.0:1789403231.823963:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046336 00000100:00100000:3.0:1789403231.823994:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046208 00000100:00100000:3.0:1789403231.823997:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046208 00000100:00100000:3.0:1789403231.824016:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403231.824022:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038046336:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403231.824049:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038046336:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (2604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403231.824055:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403231.824067:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1789403231.824073:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038046208:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403231.824092:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038046208:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 20us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403231.824098:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00080000:3.0:1789403231.825373:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403231.825380:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403231.986496:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050703232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403231.986569:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403231.986664:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703232 00000100:00100000:1.0:1789403231.986671:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703232 00000100:00100000:1.0:1789403231.986728:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789403231.986737:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050703232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403231.986762:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403231.987019:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050703232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 282us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403231.987044:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789403231.987085:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698380 x1876325050703232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403231.987115:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050703232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403231.987322:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403231.987334:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050703360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403231.987361:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403231.987386:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703360 00000100:00100000:3.0:1789403231.987405:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703360 00000100:00100000:3.0:1789403231.987430:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789403231.987436:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050703360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403231.987452:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403231.987492:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050703360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403231.987498:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789403231.987513:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403231.987529:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143019880 x1876325050703360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403231.987542:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050703360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403232.499702:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050703488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403232.499772:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403232.499843:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703488 00000100:00100000:3.0:1789403232.499850:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703488 00000100:00100000:3.0:1789403232.499894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789403232.499902:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050703488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403232.499934:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403232.499975:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050703488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403232.499981:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789403232.500022:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050703488:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403232.754794:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403233.521945:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403233.521967:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050703616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403233.522032:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403233.522097:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703616 00000100:00100000:3.0:1789403233.522104:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703616 00000100:00100000:3.0:1789403233.522148:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789403233.522156:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050703616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403233.522212:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403233.522258:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050703616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403233.522265:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789403233.522309:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050703616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403233.777850:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403234.033536:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050703872:0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.033593:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050704000:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.033605:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403234.033628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403234.033670:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050703744:0@lo:400:kworker.0 00000100:00100000:2.0:1789403234.033845:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050704128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.038488:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050704384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.038579:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403234.038635:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050704896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.038659:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403234.038700:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703872 00000100:00100000:1.0:1789403234.038708:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703872 00000100:00100000:1.0:1789403234.038755:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704384 00000100:00100000:1.0:1789403234.038759:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704384 00000100:00100000:1.0:1789403234.038819:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704896 00000100:00100000:1.0:1789403234.038823:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704896 00000100:00100000:3.0:1789403234.038836:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050704512:0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.038866:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403234.038880:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050705024:0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.038900:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403234.038926:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704000 00000100:00100000:3.0:1789403234.038931:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704000 00000100:00100000:3.0:1789403234.038972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789403234.038980:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050704000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.039037:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d210c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050704000:12345-0@lo:400:kworker.0 Request processed in 57us (5407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403234.039043:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789403234.039120:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704512 00000100:00100000:1.0:1789403234.039125:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704512 00000100:00100000:1.0:1789403234.039169:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705024 00000100:00100000:1.0:1789403234.039204:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705024 00000100:00100000:1.0:1789403234.039228:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789403234.039236:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050703872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039274:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050703872:12345-0@lo:400:kworker.0 Request processed in 40us (5670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403234.039280:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789403234.039292:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789403234.039313:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050704384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039361:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050704384:12345-0@lo:400:kworker.0 Request processed in 33us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403234.039368:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789403234.039411:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789403234.039433:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050704896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039501:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050704896:12345-0@lo:400:kworker.0 Request processed in 73us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403234.039507:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789403234.039519:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789403234.039551:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050704512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039606:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050704512:12345-0@lo:400:kworker.0 Request processed in 80us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403234.039611:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789403234.039641:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789403234.039647:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050705024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039685:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050705024:12345-0@lo:400:kworker.0 Request processed in 39us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403234.039689:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789403234.039714:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403234.039718:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403234.039747:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050704384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039760:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050704896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039785:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050703872:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039856:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050705408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403234.039863:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050704000:0@lo:400:kworker.0 00010000:00080000:3.0:1789403234.039878:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143019c00 x1876325050704512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403234.039892:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050704512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039892:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789403234.039907:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143019500 x1876325050705024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403234.039930:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050705024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403234.039938:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705408 00000100:00100000:1.0:1789403234.039943:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705408 00000100:00100000:1.0:1789403234.039970:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789403234.039974:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050705408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403234.039991:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403234.040014:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050705408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403234.040018:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789403234.040029:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789403234.040039:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a5f80 x1876325050705408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403234.040049:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050705408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403234.045015:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403234.045078:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050704256:0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.045110:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403234.045137:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704256 00000100:00100000:0.0:1789403234.045145:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704256 00000100:00100000:0.0:1789403234.045303:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789403234.045314:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050704256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.045372:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050704256:12345-0@lo:400:kworker.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403234.045380:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789403234.045459:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050704256:0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.045469:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050704768:0@lo:400:kworker.0 00000100:00100000:2.0:1789403234.045475:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403234.045505:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403234.045514:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050704640:0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.045536:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704768 00000100:00100000:0.0:1789403234.045541:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704768 00000100:00100000:2.0:1789403234.045554:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403234.045579:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050705152:0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.045582:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704640 00000100:00100000:0.0:1789403234.045586:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704640 00000100:00100000:2.0:1789403234.045605:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403234.045612:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705152 00000100:00100000:0.0:1789403234.045616:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705152 00000100:00100000:0.0:1789403234.045635:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789403234.045642:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050704768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403234.045682:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050704128 00000100:00100000:2.0:1789403234.045687:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050704128 00000100:00100000:0.0:1789403234.045693:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050704768:12345-0@lo:400:kworker.0 Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403234.045702:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789403234.045723:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789403234.045727:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789403234.045734:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050704640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403234.045739:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050704128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.045775:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050704640:12345-0@lo:400:kworker.0 Request processed in 43us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403234.045790:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050704128:12345-0@lo:400:kworker.0 Request processed in 55us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403234.045795:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789403234.046539:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050703744 00000100:00100000:3.0:1789403234.046546:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050703744 00000100:00100000:3.0:1789403234.046585:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789403234.046594:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050703744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.046643:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050703744:12345-0@lo:400:kworker.0 Request processed in 51us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403234.046649:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789403234.048633:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789403234.048650:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403234.048666:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050705152:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789403234.048683:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403234.048734:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14301b800 x1876325050704768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403234.048740:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050705152:12345-0@lo:400:kworker.0 Request processed in 79us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403234.048755:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789403234.048759:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050704768:0@lo:400:kworker.0 00000100:00100000:0.0:1789403234.048773:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050705280:0@lo:400:kworker.0 00000100:00100000:2.0:1789403234.048779:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403234.048793:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403234.048814:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403234.048828:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403234.048875:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050703744:0@lo:400:kworker.0 00000100:00100000:2.0:1789403234.048939:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050704128:0@lo:400:kworker.0 00010000:00080000:2.0:1789403234.048952:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143019180 x1876325050704640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403234.048968:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050704640:0@lo:400:kworker.0 00010000:00080000:2.0:1789403234.048981:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14301bb80 x1876325050705152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403234.048989:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050705152:0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.049207:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705536 00000100:00100000:3.0:1789403234.049213:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705536 00000100:00080000:0.0:1789403234.049295:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403234.049788:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789403234.049797:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050705536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403234.049857:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403234.049972:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050705536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403234.049979:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1789403234.050131:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144042d80 x1876325050705536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403234.050163:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403234.050198:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705280 00000100:00100000:3.0:1789403234.050204:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705280 00000100:00100000:3.0:1789403234.050269:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789403234.050276:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050705280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403234.050314:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050705280:12345-0@lo:400:kworker.0 Request processed in 39us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403234.050321:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789403234.050373:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143530a80 x1876325050705280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403234.050384:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050705280:0@lo:400:kworker.0 00010000:00010000:3.0:1789403234.801548:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789403235.453304:0:12485:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403235.454013:0:12485:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789403235.826312:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403236.854547:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403236.940029:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940067:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940102:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940135:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940156:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940188:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940236:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403236.940266:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047104 00000100:00100000:2.0:1789403236.940274:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047104 00000100:00100000:2.0:1789403236.940327:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047232 00000100:00100000:2.0:1789403236.940331:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047232 00000100:00100000:2.0:1789403236.940354:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:2.0:1789403236.940364:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038047104:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403236.940637:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046592 00000100:00100000:1.0:1789403236.940642:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046592 00000100:00100000:1.0:1789403236.940667:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046848 00000100:00100000:1.0:1789403236.940670:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046848 00000100:00100000:1.0:1789403236.940682:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046720 00000100:00100000:1.0:1789403236.940684:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046720 00000100:00100000:2.0:1789403236.940691:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038047104:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 328us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403236.940695:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046976 00000100:00100000:1.0:1789403236.940697:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046976 00000100:00100000:2.0:1789403236.940698:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:2.0:1789403236.940720:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1789403236.940720:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:2.0:1789403236.940727:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038047232:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403236.940727:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038046592:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403236.940751:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038047232:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403236.940765:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038046592:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403236.940768:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:1.0:1789403236.940770:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:2.0:1789403236.940786:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038046464 00000100:00100000:1.0:1789403236.940788:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:2.0:1789403236.940789:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038046464 00000100:00100000:1.0:1789403236.940793:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038046848:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403236.940809:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 306 00000100:00100000:2.0:1789403236.940815:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038046464:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403236.940818:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038046848:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403236.940823:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:2.0:1789403236.940834:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038046464:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 20us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403236.940834:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 154 00000100:00100000:1.0:1789403236.940839:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038046720:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403236.940840:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 306 00000100:00100000:1.0:1789403236.940859:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038046720:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 19us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403236.940864:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 154 00000100:00100000:2.0:1789403236.941116:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00100000:2.0:1789403236.941124:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038046976:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403236.941150:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038046976:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403236.941156:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00080000:2.0:1789403236.941318:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403236.941323:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403236.941325:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403236.941327:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403237.106049:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403237.106073:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050705664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403237.106146:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403237.106438:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705664 00000100:00100000:2.0:1789403237.106448:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705664 00000100:00100000:2.0:1789403237.106503:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789403237.106512:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a275112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050705664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403237.106538:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403237.106582:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a275112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050705664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403237.106589:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789403237.106898:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403237.106926:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1437e7100 x1876325050705664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403237.106944:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050705664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403237.109932:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050705792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403237.109993:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403237.110082:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705792 00000100:00100000:1.0:1789403237.110091:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705792 00000100:00100000:1.0:1789403237.110151:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789403237.110160:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050705792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403237.110179:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403237.110233:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050705792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403237.110239:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789403237.110273:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f78380 x1876325050705792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403237.110290:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050705792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789403237.110475:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403237.618583:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050705920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403237.618654:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403237.618843:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050705920 00000100:00100000:3.0:1789403237.618853:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050705920 00000100:00100000:3.0:1789403237.618942:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789403237.618952:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050705920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403237.618985:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403237.619033:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050705920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403237.619041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789403237.626668:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050705920:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1789403237.829621:0:12583:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403237.830986:0:12583:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403237.874536:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403238.642600:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403238.642624:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050706048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403238.642696:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403238.642755:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706048 00000100:00100000:3.0:1789403238.642762:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706048 00000100:00100000:3.0:1789403238.642805:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789403238.642814:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050706048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403238.642863:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403238.642907:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050706048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403238.642913:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789403238.642959:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050706048:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789403238.898745:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403239.153583:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403239.153607:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050706176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403239.153679:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403239.153747:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706176 00000100:00100000:1.0:1789403239.153765:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706176 00000100:00100000:1.0:1789403239.153823:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789403239.153834:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050706176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403239.153861:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403239.153916:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050706176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403239.153923:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789403239.153942:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789403239.153970:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79180 x1876325050706176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403239.153988:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050706176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403239.154297:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050706304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403239.154323:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.154384:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706304 00000100:00100000:0.0:1789403239.154423:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706304 00000100:00100000:0.0:1789403239.154454:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789403239.154461:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050706304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403239.154472:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403239.154503:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050706304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.154510:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789403239.154810:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050706560:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.154840:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.154861:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050707072:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.154895:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.154911:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050707584:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.154930:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.154945:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789403239.154950:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050706432:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.154975:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.154996:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050706944:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.155192:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.155215:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050707456:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.155240:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403239.155268:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706560 00000100:00100000:0.0:1789403239.155273:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706560 00000100:00100000:0.0:1789403239.155299:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707072 00000100:00100000:0.0:1789403239.155302:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707072 00000100:00100000:0.0:1789403239.155317:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707584 00000100:00100000:0.0:1789403239.155319:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707584 00000100:00100000:0.0:1789403239.155333:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789403239.155340:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050706560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.155380:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050706560:12345-0@lo:400:kworker.0 Request processed in 40us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.155386:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789403239.155437:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789403239.155445:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050707072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.155473:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050707072:12345-0@lo:400:kworker.0 Request processed in 29us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.155479:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789403239.155491:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789403239.155497:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050707584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.155523:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050707584:12345-0@lo:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.155529:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789403239.155625:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707456 00000100:00100000:0.0:1789403239.155630:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707456 00000100:00100000:0.0:1789403239.155659:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789403239.155675:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050707456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.155708:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050707456:12345-0@lo:400:kworker.0 Request processed in 35us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.155715:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789403239.156095:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143513480 x1876325050707456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403239.156111:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050707456:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.156127:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050706560:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.156138:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050707072:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.156147:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050707584:0@lo:400:kworker.0 00000100:00080000:1.0:1789403239.156246:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789403239.156251:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403239.156253:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403239.156270:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050706816:0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.156302:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403239.156322:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050707328:0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.156343:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789403239.156365:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f79180 x1876325050706304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403239.156421:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050706304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403239.156436:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789403239.156442:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050706688:0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.156467:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403239.156484:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050707200:0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.156503:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403239.156520:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050707712:0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.156673:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403239.156706:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707328 00000100:00100000:1.0:1789403239.156712:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707328 00000100:00100000:1.0:1789403239.156821:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789403239.156830:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050707328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403239.156972:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706432 00000100:00100000:3.0:1789403239.156976:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706432 00000100:00100000:3.0:1789403239.157005:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789403239.157011:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050706432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.157072:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706816 00000100:00100000:0.0:1789403239.157077:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706816 00000100:00100000:0.0:1789403239.157096:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707200 00000100:00100000:0.0:1789403239.157098:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707200 00000100:00100000:0.0:1789403239.157109:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707712 00000100:00100000:0.0:1789403239.157111:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707712 00000100:00100000:0.0:1789403239.157123:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789403239.157128:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050706816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.157165:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050707328:12345-0@lo:400:kworker.0 Request processed in 336us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403239.157171:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789403239.157196:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789403239.157203:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050707200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403239.158122:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706944 00000100:00100000:2.0:1789403239.158129:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706944 00000100:00100000:2.0:1789403239.158155:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050706688 00000100:00100000:2.0:1789403239.158158:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050706688 00000100:00100000:2.0:1789403239.158172:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403239.158178:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050706944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403239.167492:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050706432:12345-0@lo:400:kworker.0 Request processed in 10470us (12505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403239.167506:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789403239.176924:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050706432:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.177015:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050706816:12345-0@lo:400:kworker.0 Request processed in 19885us (20711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.177027:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789403239.177059:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789403239.177071:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050707712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.177142:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050707712:12345-0@lo:400:kworker.0 Request processed in 77us (20469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403239.177150:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789403239.178823:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050707200:12345-0@lo:400:kworker.0 Request processed in 21614us (22312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403239.178835:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1789403239.178884:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403239.178890:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789403239.178927:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143511500 x1876325050707200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403239.178958:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050707200:0@lo:400:kworker.0 00010000:00080000:1.0:1789403239.178974:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143510380 x1876325050707712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403239.178983:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050707712:0@lo:400:kworker.0 00000100:00100000:1.0:1789403239.178996:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050706816:0@lo:400:kworker.0 00010000:00080000:1.0:1789403239.179006:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143513b80 x1876325050707328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403239.179013:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050707328:0@lo:400:kworker.0 00000100:00100000:2.0:1789403239.180582:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050706944:12345-0@lo:400:kworker.0 Request processed in 22400us (25548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403239.180596:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403239.180630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789403239.180641:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050706688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403239.180708:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050706688:12345-0@lo:400:kworker.0 Request processed in 71us (24240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403239.180715:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789403239.180798:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050706688:0@lo:400:kworker.0 00000100:00100000:0.0:1789403239.181293:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050706944:0@lo:400:kworker.0 00010000:00010000:3.0:1789403239.922160:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789403240.630261:0:12681:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403240.630635:0:12681:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403240.945757:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403241.969555:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403242.064034:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064066:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064107:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064134:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064155:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064175:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064234:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403242.064264:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047360 00000100:00100000:3.0:1789403242.064273:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047360 00000100:00100000:3.0:1789403242.064319:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 308 00000100:00100000:3.0:1789403242.064330:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038047360:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403242.064462:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038047360:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.064470:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 308 00000100:00100000:3.0:1789403242.064504:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048000 00000100:00100000:3.0:1789403242.064508:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048000 00000100:00100000:3.0:1789403242.064539:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048128 00000100:00100000:3.0:1789403242.064542:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048128 00000100:00100000:3.0:1789403242.064560:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1789403242.064567:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2386:x1876325038048000:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:3.0:1789403242.064587:0:8417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760cad 00000100:00080000:3.0:1789403242.064612:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a14371a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403242.064660:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789403242.064778:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+2:2386:x1876325038048000:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 210us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.064785:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1789403242.064798:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403242.064804:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2386:x1876325038048128:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:3.0:1789403242.064814:0:8417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760cb4 00000100:00080000:3.0:1789403242.064820:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a14368e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403242.064841:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789403242.064909:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+2:2386:x1876325038048128:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 105us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.064916:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403242.064935:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047488 00000100:00100000:3.0:1789403242.064938:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047488 00000100:00100000:3.0:1789403242.064957:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047744 00000100:00100000:3.0:1789403242.064959:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047744 00000100:00100000:3.0:1789403242.064970:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047616 00000100:00100000:3.0:1789403242.064973:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047616 00000100:00100000:3.0:1789403242.064983:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038047872 00000100:00100000:3.0:1789403242.064985:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038047872 00000100:00100000:3.0:1789403242.065006:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:3.0:1789403242.065012:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038047488:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403242.065040:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038047488:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.065046:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:3.0:1789403242.065057:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:3.0:1789403242.065062:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038047744:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403242.065096:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038047744:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.065103:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:3.0:1789403242.065114:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:3.0:1789403242.065120:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038047616:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403242.065144:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038047616:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.065150:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:3.0:1789403242.065161:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1789403242.065167:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038047872:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403242.065188:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038047872:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 21us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.065193:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00010000:00010000:3.0:1789403242.065316:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403242.065322:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789403242.065805:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403242.065810:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403242.065812:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403242.065814:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403242.226462:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050707840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403242.226530:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403242.226623:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707840 00000100:00100000:0.0:1789403242.226630:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707840 00000100:00100000:0.0:1789403242.226687:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789403242.226697:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050707840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789403242.226723:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403242.226767:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050707840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403242.226774:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789403242.226813:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143512d80 x1876325050707840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403242.226830:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050707840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789403242.226882:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403242.226983:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050707968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403242.227011:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403242.227340:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050707968 00000100:00100000:1.0:1789403242.227346:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050707968 00000100:00100000:1.0:1789403242.227378:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789403242.227413:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050707968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403242.227425:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789403242.227484:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403242.231271:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050707968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3878us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403242.231286:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789403242.235516:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3ce00 x1876325050707968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403242.235548:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050707968:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1789403242.537991:0:12778:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403242.540020:0:12778:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789403242.744816:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050708096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403242.744891:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403242.746909:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708096 00000100:00100000:3.0:1789403242.746926:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708096 00000100:00100000:3.0:1789403242.747081:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789403242.747091:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050708096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403242.747129:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403242.751307:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050708096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4209us (6407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403242.751338:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789403242.755007:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050708096:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403242.994913:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403243.761531:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403243.761572:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050708224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403243.762450:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403243.763019:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708224 00000100:00100000:0.0:1789403243.763039:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708224 00000100:00100000:0.0:1789403243.763093:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789403243.763105:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050708224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403243.763138:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403243.763202:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050708224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403243.763210:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789403243.764524:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050708224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403244.019698:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403244.273973:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050708352:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274046:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274116:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050708864:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274155:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274176:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050709376:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274197:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274213:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050709888:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274232:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274257:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789403244.274263:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050708736:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274286:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274313:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050709248:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274334:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274353:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050709760:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274382:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274427:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050708480:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274450:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274468:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050708992:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274487:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274502:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050709504:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274521:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274535:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050710016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403244.274570:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274589:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789403244.274595:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050708608:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274617:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274644:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050709120:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274666:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274676:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050709632:0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274694:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403244.274721:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708864 00000100:00100000:1.0:1789403244.274728:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708864 00000100:00100000:1.0:1789403244.274765:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708608 00000100:00100000:1.0:1789403244.274768:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708608 00000100:00100000:1.0:1789403244.274784:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789403244.274791:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050708864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274851:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050708864:12345-0@lo:400:kworker.0 Request processed in 59us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403244.274859:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789403244.274881:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789403244.274889:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050708608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.274902:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708352 00000100:00100000:3.0:1789403244.274909:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708352 00000100:00100000:1.0:1789403244.274923:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050708608:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403244.274930:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789403244.274947:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789403244.274955:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709376 00000100:00100000:3.0:1789403244.274958:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050708352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403244.274961:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709376 00000100:00100000:1.0:1789403244.274999:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709888 00000100:00100000:1.0:1789403244.275003:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709888 00000100:00100000:3.0:1789403244.275006:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050708352:12345-0@lo:400:kworker.0 Request processed in 50us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403244.275016:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789403244.275018:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709248 00000100:00100000:1.0:1789403244.275022:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709248 00000100:00100000:1.0:1789403244.275042:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709760 00000100:00100000:1.0:1789403244.275045:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709760 00000100:00100000:3.0:1789403244.275058:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789403244.275068:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050709376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.275108:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050709376:12345-0@lo:400:kworker.0 Request processed in 41us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275508:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708736 00000100:00100000:2.0:1789403244.275520:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708736 00000100:00100000:2.0:1789403244.275543:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708480 00000100:00100000:2.0:1789403244.275545:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708480 00000100:00100000:2.0:1789403244.275572:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050708992 00000100:00100000:2.0:1789403244.275574:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050708992 00000100:00100000:2.0:1789403244.275587:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709504 00000100:00100000:2.0:1789403244.275589:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709504 00000100:00100000:2.0:1789403244.275601:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709120 00000100:00100000:2.0:1789403244.275603:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709120 00000100:00100000:2.0:1789403244.275614:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050709632 00000100:00100000:2.0:1789403244.275617:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050709632 00000100:00100000:2.0:1789403244.275630:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789403244.275637:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050708736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403244.275674:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050708736:12345-0@lo:400:kworker.0 Request processed in 38us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275680:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789403244.275694:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789403244.275700:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050708480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403244.275728:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050708480:12345-0@lo:400:kworker.0 Request processed in 29us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275733:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789403244.275743:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789403244.275748:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050708992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403244.275771:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050708992:12345-0@lo:400:kworker.0 Request processed in 24us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275776:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789403244.275786:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789403244.275791:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050709504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403244.275827:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050709504:12345-0@lo:400:kworker.0 Request processed in 36us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275832:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789403244.275843:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789403244.275848:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050709120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403244.275872:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050709120:12345-0@lo:400:kworker.0 Request processed in 24us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275877:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789403244.275888:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789403244.275893:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050709632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403244.275917:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050709632:12345-0@lo:400:kworker.0 Request processed in 24us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403244.275922:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789403244.276096:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789403244.276114:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789403244.276121:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050709888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276164:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050709888:12345-0@lo:400:kworker.0 Request processed in 45us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403244.276170:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789403244.276180:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789403244.276185:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050709248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276211:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050709248:12345-0@lo:400:kworker.0 Request processed in 26us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403244.276216:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789403244.276235:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403244.276241:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050709760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276271:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050709760:12345-0@lo:400:kworker.0 Request processed in 31us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403244.276276:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403244.276338:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710016 00000100:00100000:3.0:1789403244.276344:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710016 00000100:00100000:3.0:1789403244.276408:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403244.276416:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050710016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403244.276437:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403244.276467:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050710016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403244.276473:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789403244.276519:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403244.276523:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403244.276526:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403244.276528:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403244.276650:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050710144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403244.276689:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403244.276757:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050708608:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.276773:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649880 x1876325050709120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.276784:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050709120:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.276794:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64b480 x1876325050709632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.276802:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050709632:0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276825:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050708480:0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276834:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050708992:0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276856:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050709504:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.276866:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f3c000 x1876325050710016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.276881:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050710016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403244.276928:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050708736:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.276942:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64a300 x1876325050709248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.276950:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050709248:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.276960:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a648e00 x1876325050709760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.276966:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050709760:0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276975:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050708352:0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.276985:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050708864:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.276996:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a648380 x1876325050709376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.277003:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050709376:0@lo:400:kworker.0 00010000:00080000:3.0:1789403244.277012:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649c00 x1876325050709888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.277030:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050709888:0@lo:400:kworker.0 00000100:00100000:3.0:1789403244.277073:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710144 00000100:00100000:3.0:1789403244.277077:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710144 00000100:00100000:3.0:1789403244.277108:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403244.277115:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050710144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403244.277125:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403244.277157:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050710144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403244.277163:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789403244.277186:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3dc00 x1876325050710144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403244.277197:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050710144:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1789403244.403545:0:12876:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403244.403874:0:12876:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789403245.041899:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403246.074521:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403247.089609:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403247.180596:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403247.180649:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403247.180691:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403247.180716:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403247.180743:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403247.180825:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048384 00000100:00100000:1.0:1789403247.180848:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048384 00000100:00100000:1.0:1789403247.180915:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048640 00000100:00100000:1.0:1789403247.180919:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048640 00000100:00100000:1.0:1789403247.180936:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048512 00000100:00100000:1.0:1789403247.180939:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048512 00000100:00100000:1.0:1789403247.180952:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048768 00000100:00100000:1.0:1789403247.180954:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048768 00000100:00100000:1.0:1789403247.180971:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:1.0:1789403247.180982:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038048384:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403247.181076:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038048384:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 96us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403247.181085:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:1.0:1789403247.181579:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:1.0:1789403247.181591:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038048640:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403247.181623:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038048640:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403247.181629:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:1.0:1789403247.181644:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:1.0:1789403247.181650:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038048512:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403247.181673:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038048512:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403247.181679:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:1.0:1789403247.181690:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:1.0:1789403247.181696:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038048768:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403247.181718:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038048768:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403247.181732:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:3.0:1789403247.181827:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048256 00000100:00100000:3.0:1789403247.181833:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048256 00000100:00100000:3.0:1789403247.181875:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 310 00000100:00100000:3.0:1789403247.181883:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038048256:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403247.181909:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038048256:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403247.181915:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 310 00000100:00080000:2.0:1789403247.182619:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403247.182625:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403247.345585:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050710272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403247.345665:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403247.345774:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710272 00000100:00100000:2.0:1789403247.345781:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710272 00000100:00100000:2.0:1789403247.345825:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789403247.345833:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050710272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403247.345856:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789403247.346703:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143513480 x1876325050710272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403247.346725:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050710272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403247.346736:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050710272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 903us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403247.346744:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789403247.346772:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403247.346805:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403247.346817:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050710400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403247.346850:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403247.346932:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710400 00000100:00100000:2.0:1789403247.346938:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710400 00000100:00100000:2.0:1789403247.347128:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789403247.347137:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050710400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403247.347152:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403247.347191:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050710400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403247.347196:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789403247.347297:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3dc00 x1876325050710400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403247.347311:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050710400:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789403247.347355:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403247.857554:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403247.857584:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050710528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403247.857675:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403247.857809:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710528 00000100:00100000:2.0:1789403247.857820:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710528 00000100:00100000:2.0:1789403247.857880:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789403247.857892:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050710528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403247.857933:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403247.857985:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050710528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403247.857992:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789403247.858540:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050710528:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1789403247.865303:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000020:00000080:1.0:1789403247.865317:0:9495:0:(genops.c:885:class_export_put()) final put ffff90a14368a000/e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000020:00000080:2.0:1789403247.865961:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14368a000/e558fa5f-d909-4a9e-a611-b5e26918f0ce for lustre-OST0001 00000020:00000080:2.0:1789403247.866029:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14368e000 for lustre-OST0001 00000001:00100000:0.0:1789403247.870184:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000020:00000080:0.0:1789403247.870194:0:8409:0:(genops.c:885:class_export_put()) final put ffff90a14371e000/e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000020:00000080:2.0:1789403247.870412:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14371e000/e558fa5f-d909-4a9e-a611-b5e26918f0ce for lustre-OST0000 00000020:00000080:2.0:1789403247.870459:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14371a800 for lustre-OST0000 00000001:02000400:2.0:1789403247.921128:0:13020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789403248.113522:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403248.885568:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403248.885590:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050710656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403248.885977:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403248.886296:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710656 00000100:00100000:2.0:1789403248.886304:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710656 00000100:00100000:2.0:1789403248.886378:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789403248.886412:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050710656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403248.886449:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403248.886501:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050710656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403248.886508:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789403248.886975:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050710656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403249.137765:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403249.397545:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050710784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403249.397737:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403249.397772:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710784 00000100:00100000:2.0:1789403249.397780:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710784 00000100:00100000:2.0:1789403249.397839:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789403249.397850:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050710784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403249.397879:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403249.398185:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050710784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 337us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403249.398193:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789403249.398218:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403249.400070:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050710912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403249.400135:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403249.400173:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050711040:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.400181:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050711424:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405381:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405469:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050711936:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405540:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405562:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050712448:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405584:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405613:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789403249.405621:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050711296:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405643:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405662:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050711808:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405683:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405701:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050712320:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405721:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405751:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050711168:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405776:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405794:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050711680:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405818:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405829:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050712192:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.405849:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403249.405875:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050710912 00000100:00100000:1.0:1789403249.405884:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050710912 00000100:00100000:1.0:1789403249.405937:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789403249.405946:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050710912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403249.405972:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403249.406018:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050710912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406025:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789403249.406047:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711936 00000100:00100000:1.0:1789403249.406056:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711936 00000100:00100000:1.0:1789403249.406083:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050712448 00000100:00100000:1.0:1789403249.406086:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050712448 00000100:00100000:1.0:1789403249.406104:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789403249.406111:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050711936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406144:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050711936:12345-0@lo:400:kworker.0 Request processed in 34us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406151:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789403249.406162:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403249.406168:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050712448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406192:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050712448:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406197:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403249.406217:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711296 00000100:00100000:1.0:1789403249.406221:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711296 00000100:00100000:1.0:1789403249.406246:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789403249.406252:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050711296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406283:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050711296:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406288:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789403249.406305:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711424 00000100:00100000:1.0:1789403249.406308:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711424 00000100:00100000:1.0:1789403249.406325:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711808 00000100:00100000:1.0:1789403249.406339:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711808 00000100:00100000:1.0:1789403249.406354:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050712320 00000100:00100000:1.0:1789403249.406357:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050712320 00000100:00100000:1.0:1789403249.406368:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711168 00000100:00100000:1.0:1789403249.406370:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711168 00000100:00100000:1.0:1789403249.406380:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711680 00000100:00100000:1.0:1789403249.406410:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711680 00000100:00100000:1.0:1789403249.406425:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050712192 00000100:00100000:1.0:1789403249.406427:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050712192 00000100:00100000:1.0:1789403249.406439:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789403249.406444:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050711424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406475:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050711424:12345-0@lo:400:kworker.0 Request processed in 31us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406481:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789403249.406492:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789403249.406497:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050711808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406522:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050711808:12345-0@lo:400:kworker.0 Request processed in 25us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406527:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789403249.406537:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789403249.406542:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050712320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406568:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050712320:12345-0@lo:400:kworker.0 Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406574:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789403249.406584:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789403249.406590:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050711168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406619:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050711168:12345-0@lo:400:kworker.0 Request processed in 29us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406625:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789403249.406636:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789403249.406641:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050711680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406666:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050711680:12345-0@lo:400:kworker.0 Request processed in 26us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406679:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789403249.406690:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789403249.406695:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050712192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406722:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050712192:12345-0@lo:400:kworker.0 Request processed in 28us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.406728:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1789403249.406752:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403249.406757:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403249.406759:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789403249.406761:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403249.406803:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050711168:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406814:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050711680:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406822:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050712192:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406851:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050711296:0@lo:400:kworker.0 00010000:00080000:1.0:1789403249.406864:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143512a00 x1876325050711808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403249.406873:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050711808:0@lo:400:kworker.0 00010000:00080000:1.0:1789403249.406882:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7b800 x1876325050712320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403249.406890:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050712320:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.406899:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050711424:0@lo:400:kworker.0 00010000:00080000:1.0:1789403249.406908:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143513b80 x1876325050711936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403249.406923:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050711936:0@lo:400:kworker.0 00010000:00080000:1.0:1789403249.406934:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f7a680 x1876325050712448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403249.406942:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050712448:0@lo:400:kworker.0 00010000:00080000:1.0:1789403249.406951:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aae680 x1876325050710912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403249.406965:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050710912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403249.410885:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403249.410968:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050711552:0@lo:400:kworker.0 00000100:00100000:0.0:1789403249.411033:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403249.411050:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050712064:0@lo:400:kworker.0 00000100:00100000:0.0:1789403249.411071:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403249.411236:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711040 00000100:00100000:2.0:1789403249.411245:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711040 00000100:00100000:2.0:1789403249.411294:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789403249.411305:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050711040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403249.411377:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050711040:12345-0@lo:400:kworker.0 Request processed in 73us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403249.411383:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789403249.411452:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050711040:0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.411560:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050711552 00000100:00100000:1.0:1789403249.411566:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050711552 00000100:00100000:1.0:1789403249.411594:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789403249.411601:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050711552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.411645:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050711552:12345-0@lo:400:kworker.0 Request processed in 45us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.411652:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789403249.411669:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050712064 00000100:00100000:1.0:1789403249.411672:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050712064 00010000:00080000:3.0:1789403249.411909:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143512300 x1876325050710784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403249.411949:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050710784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403249.412190:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789403249.412199:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050712064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403249.412233:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050712064:12345-0@lo:400:kworker.0 Request processed in 37us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403249.412239:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789403249.412260:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403249.412286:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050711552:0@lo:400:kworker.0 00010000:00080000:1.0:1789403249.412298:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143510380 x1876325050712064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403249.412316:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050712064:0@lo:400:kworker.0 00010000:00010000:2.0:1789403250.161624:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789403251.184071:0:13167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeae1be070 20000000:00000080:2.0:1789403251.184099:0:13167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a277b8c400 uarg=0000000000000000 20000000:01000000:2.0:1789403251.184155:0:13167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789403251.184170:0:13167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789403251.184176:0:13167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00010000:00010000:0.0:1789403251.186760:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403251.187270:0:13168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789403251.187810:0:13167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789403251.211644:0:13167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789403251.211916:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.211943:0:13167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.211963:0:13167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.211972:0:13167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.211979:0:13167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.211990:0:13167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.211998:0:13167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212007:0:13167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212073:0:13167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212088:0:13167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 12 pid: 6493 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.212117:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712576:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403251.212248:0:13167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212257:0:13167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 12 pid: 6495 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.212266:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712704:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403251.212290:0:13167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212298:0:13167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 23 pid: 6495 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.212307:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712832:0@lo:104: 00000100:00100000:3.0:1789403251.212362:0:13167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403251.212433:0:13167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212441:0:13167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.212449:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712960:0@lo:104: 00000100:00100000:3.0:1789403251.212467:0:13167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403251.212490:0:13167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212498:0:13167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 23 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.212513:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050713088:0@lo:104: 00000100:00100000:3.0:1789403251.212534:0:13167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403251.212557:0:13167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.212565:0:13167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 23 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.212572:0:13167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050713216:0@lo:104: 00000100:00100000:3.0:1789403251.212591:0:13167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403251.212601:0:13167:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274f0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403251.213599:0:10379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050712832 00000100:00100000:2.0:1789403251.213612:0:10379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050712832 00000100:00100000:2.0:1789403251.213662:0:10379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050712960 00000100:00100000:2.0:1789403251.213665:0:10379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050712960 00000100:00100000:2.0:1789403251.213673:0:10379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713088 00000100:00100000:2.0:1789403251.213675:0:10379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713088 00000100:00100000:2.0:1789403251.213684:0:10379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713216 00000100:00100000:2.0:1789403251.213687:0:10379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713216 00000100:00100000:2.0:1789403251.213701:0:10379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789403251.213709:0:10379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:13167:x1876325050712832:12345-0@lo:104: 00010000:00010000:2.0:1789403251.213727:0:10379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403251.213859:0:10379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403251.213866:0:10379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:13167:x1876325050712832:12345-0@lo:104: Request processed in 157us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403251.213873:0:10379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403251.213884:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789403251.213893:0:10379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789403251.213895:0:6484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:13167:x1876325050712960:12345-0@lo:104: 00000100:00100000:2.0:1789403251.213898:0:10379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:13167:x1876325050713088:12345-0@lo:104: 00010000:00010000:2.0:1789403251.213905:0:10379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.213905:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403251.214251:0:10379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789403251.214258:0:10379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:13167:x1876325050713088:12345-0@lo:104: Request processed in 359us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403251.214264:0:10379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789403251.214291:0:10379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789403251.214297:0:10379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:13167:x1876325050713216:12345-0@lo:104: 00010000:00010000:2.0:1789403251.214306:0:10379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.214552:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789403251.214560:0:6484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:13167:x1876325050712960:12345-0@lo:104: Request processed in 668us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403251.214912:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1789403251.215043:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789403251.215053:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215061:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403251.215066:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215075:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403251.215084:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403251.215090:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403251.215135:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215156:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403251.215183:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215190:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b760c75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c7c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215207:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789403251.215210:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215216:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403251.215218:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215225:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403251.215232:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403251.215237:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403251.215256:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215262:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403251.215268:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215274:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b760c59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c60 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215293:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403251.215296:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215302:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403251.215305:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215312:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403251.215331:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403251.215337:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403251.215352:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215357:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403251.215404:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215411:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b760c67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c6e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215420:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403251.215423:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215439:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403251.215442:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403251.215443:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:3.0:1789403251.215449:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403251.215456:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403251.215461:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789403251.215470:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:3.0:1789403251.215475:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215481:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403251.215487:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215499:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270184400/0x5fb08b1e5b760c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760c52 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215514:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403251.215516:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403251.215518:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403251.215548:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050713344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403251.215597:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403251.215655:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403251.215662:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050713472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403251.215673:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038048896 00000100:00100000:1.0:1789403251.215681:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038048896 00000100:00100000:3.0:1789403251.215692:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403251.215715:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 13 pid: 6495 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.215723:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050713600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403251.215741:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049024 00000100:00100000:3.0:1789403251.215744:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403251.215745:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049024 00000100:00100000:3.0:1789403251.215757:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789403251.215757:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 14 pid: 6493 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.215762:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050713728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403251.215768:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713344 00000100:00100000:1.0:1789403251.215771:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713344 00010000:00010000:1.0:1789403251.215781:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 24 pid: 6495 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.215783:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403251.215791:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713472 00000100:00100000:1.0:1789403251.215800:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713472 00000100:00100000:3.0:1789403251.215806:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713600 00000100:00100000:3.0:1789403251.215809:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713600 00010000:00010000:1.0:1789403251.215811:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 25 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.215821:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 26 pid: 6492 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403251.215822:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713728 00000100:00100000:1.0:1789403251.215824:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713728 00010000:00010000:1.0:1789403251.215832:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 27 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403251.215837:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:3.0:1789403251.215844:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:166878b2-2dd8-4b83-a3c7-759691277065+14:2389:x1876325038048896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789403251.215844:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1789403251.215849:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+14:2389:x1876325038049024:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403251.215859:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403251.215859:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403251.215865:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 14 pid: 6495 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.215865:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 14 pid: 6493 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.215877:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 14 pid: 6493 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403251.216114:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712832:0@lo:104: 00000100:00100000:0.0:1789403251.216128:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712960:0@lo:104: 00000100:00100000:0.0:1789403251.216150:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050713088:0@lo:104: 00000100:00100000:0.0:1789403251.216160:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050713216:0@lo:104: 00000100:00100000:0.0:1789403251.216172:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712576:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403251.216181:0:13167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14369a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13167:1876325050712704:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403251.216231:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 14 pid: 6495 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216246:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946000/0x5fb08b1e5b760c83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128642 expref: 14 pid: 6495 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216262:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403251.216329:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038048896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 484us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403251.216336:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:3.0:1789403251.216357:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789403251.216454:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+27:3628:x1876325050713344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403251.216465:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403251.216470:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 27 pid: 6495 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216479:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 27 pid: 6495 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216489:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946400/0x5fb08b1e5b760c7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760c75 expref: 27 pid: 6495 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216498:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403251.216531:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+26:3628:x1876325050713344:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403251.216538:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789403251.216551:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403251.216557:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+25:3628:x1876325050713472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403251.216564:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403251.216568:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 25 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216577:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 25 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216586:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760c60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760c59 expref: 25 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216594:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403251.216614:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050713472:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403251.216627:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403251.216640:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403251.216646:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3626:x1876325050713600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403251.216655:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403251.216660:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216669:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216678:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b760c6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760c67 expref: 23 pid: 6492 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216687:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403251.216711:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3626:x1876325050713600:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403251.216717:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403251.216730:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403251.216736:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a607050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3626:x1876325050713728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403251.216745:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403251.216749:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 21 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216757:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 21 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216766:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0200/0x5fb08b1e5b760c52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760c4b expref: 21 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403251.216785:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403251.216806:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a607050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3626:x1876325050713728:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403251.216812:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1789403251.217449:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27200/0x5fb08b1e5b760c98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128681 expref: 12 pid: 6493 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217470:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217480:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217501:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217509:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217538:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217545:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217553:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403251.217558:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217576:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217587:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403251.217600:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403251.217641:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+11:2389:x1876325038049024:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1790us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403251.217649:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00010000:00010000:0.0:1789403251.218684:0:13167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403251.218705:0:13167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403251.218712:0:13167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403251.218719:0:13167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185a00/0x5fb08b1e5b760cbb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403251.220249:0:10379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789403251.220270:0:10379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:13167:x1876325050713216:12345-0@lo:104: Request processed in 5966us (7671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403251.220284:0:10379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789403251.220350:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403251.220357:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403251.220621:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403251.221203:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050713728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403251.221219:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050713600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403251.221262:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050713472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403251.221273:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050713344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403252.214734:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403252.298299:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403252.298362:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403252.298447:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403252.298453:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049152 00000100:00100000:1.0:1789403252.298470:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049152 00000100:00100000:0.0:1789403252.298475:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403252.298517:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403252.298545:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 312 00000100:00100000:1.0:1789403252.298558:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:2387:x1876325038049152:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403252.298569:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049408 00000100:00100000:0.0:1789403252.298574:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049408 00000100:00100000:0.0:1789403252.298614:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049664 00000100:00100000:0.0:1789403252.298618:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049664 00000100:00100000:0.0:1789403252.298632:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049280 00000100:00100000:0.0:1789403252.298634:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049280 00000100:00100000:0.0:1789403252.298646:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049536 00000100:00100000:0.0:1789403252.298648:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049536 00000100:00100000:0.0:1789403252.298684:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:0.0:1789403252.298691:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038049408:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403252.298793:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038049408:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 101us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403252.298795:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:2387:x1876325038049152:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 238us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403252.298810:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:1.0:1789403252.298814:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 312 00000100:00100000:0.0:1789403252.298837:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:0.0:1789403252.298847:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038049664:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:1.0:1789403252.298861:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403252.298878:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038049664:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403252.298884:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:0.0:1789403252.298895:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:0.0:1789403252.298901:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038049280:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403252.298924:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038049280:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403252.298930:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:0.0:1789403252.298940:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:0.0:1789403252.298959:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038049536:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403252.298984:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038049536:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403252.298990:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00080000:1.0:1789403252.300255:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403252.465628:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050713856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403252.465940:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.466068:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403252.466076:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050713984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403252.466105:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403252.468948:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713856 00000100:00100000:2.0:1789403252.468966:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713856 00000100:00100000:2.0:1789403252.469151:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050713984 00000100:00100000:2.0:1789403252.469156:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050713984 00000100:00100000:3.0:1789403252.469234:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789403252.469250:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050713856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403252.469294:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403252.469421:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050713856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.469430:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1789403252.469505:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649500 x1876325050713856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403252.469528:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050713856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789403252.472766:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403252.474206:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789403252.474225:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050713984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403252.474262:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403252.474378:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050713984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (8273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.474385:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789403252.474462:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251d880 x1876325050713984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403252.474487:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050713984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403252.488259:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403252.488349:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049792 00000100:00100000:2.0:1789403252.488362:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049792 00000100:00100000:2.0:1789403252.488445:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 313 00000100:00100000:2.0:1789403252.488454:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+11:6162:x1876325038049792:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403252.488482:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403252.488623:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286b2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.488658:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.488671:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.488682:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27000, rc 0) 00000100:00100000:2.0:1789403252.488756:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038049792:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 303us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.488764:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 313 00000100:00100000:0.0:1789403252.503646:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403252.503734:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038049920 00000100:00100000:1.0:1789403252.503748:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038049920 00000100:00100000:1.0:1789403252.503853:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 314 00000100:00100000:1.0:1789403252.503865:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038049920:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.504082:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038049920:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 211us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403252.504091:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 314 00000100:00100000:0.0:1789403252.506683:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403252.506758:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050048 00000100:00100000:3.0:1789403252.506771:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050048 00000100:00100000:3.0:1789403252.506837:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 315 00000100:00100000:3.0:1789403252.506849:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038050048:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403252.507031:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038050048:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 184us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.507040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 315 00000100:00100000:0.0:1789403252.514868:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403252.516599:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050176 00000100:00100000:3.0:1789403252.516618:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050176 00000100:00100000:3.0:1789403252.516695:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 316 00000100:00100000:3.0:1789403252.516707:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038050176:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403252.516729:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403252.516752:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286b9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.516789:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.516803:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.516818:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185600, rc 0) 00000100:00100000:3.0:1789403252.516900:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038050176:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 195us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.516907:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 316 00000100:00100000:3.0:1789403252.519935:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403252.520061:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050304 00000100:00100000:1.0:1789403252.520076:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050304 00000100:00100000:1.0:1789403252.520144:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 317 00000100:00100000:1.0:1789403252.520157:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038050304:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.520351:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038050304:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 197us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403252.520360:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 317 00000100:00100000:2.0:1789403252.525923:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403252.526031:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050432 00000100:00100000:1.0:1789403252.526046:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050432 00000100:00100000:1.0:1789403252.526121:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 318 00000100:00100000:1.0:1789403252.526134:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038050432:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.526324:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038050432:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 191us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403252.526337:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 318 10000000:01000000:3.0:1789403252.593496:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403252.593507:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a1424b5800 from 7 10000000:01000000:3.0:1789403252.593513:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403252.593586:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.593623:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.593640:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403252.593673:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403252.593766:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403252.593845:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484c7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.595159:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714112 00000100:00100000:2.0:1789403252.595179:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714112 00000100:00100000:2.0:1789403252.595244:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789403252.595256:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050714112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403252.595278:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403252.595298:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760cd0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.595344:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.595357:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.595416:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a26600, rc 0) 00000100:00100000:2.0:1789403252.595515:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050714112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.595522:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789403252.596260:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403252.596289:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.596302:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403252.596425:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403252.596470:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403252.596813:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403252.596910:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714240 00000100:00100000:3.0:1789403252.596917:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714240 00000100:00100000:3.0:1789403252.596964:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789403252.596973:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050714240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403252.597728:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050714240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 752us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.597739:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789403252.597909:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403252.597969:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403252.598118:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403252.598149:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403252.598742:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714368 00000100:00100000:3.0:1789403252.598752:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714368 00000100:00100000:3.0:1789403252.598794:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789403252.598803:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050714368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403252.598929:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050714368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.598937:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789403252.599266:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789403252.604375:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789403252.606641:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789403252.606687:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403252.606769:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.606784:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403252.606797:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403252.606800:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a27b560000 from 7 10000000:01000000:1.0:1789403252.606803:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403252.606849:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.606857:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.606869:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403252.606900:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.606979:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.607023:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403252.608524:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714496 00000100:00100000:3.0:1789403252.608551:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714496 00000100:00100000:3.0:1789403252.608653:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789403252.608671:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050714496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403252.608702:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403252.608732:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760cde expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.608784:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.608808:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403252.608821:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184400, rc 0) 00000100:00100000:3.0:1789403252.608913:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050714496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.608920:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789403252.609625:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403252.609653:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.609678:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403252.609775:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.609822:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.609867:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.609925:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714624 00000100:00100000:2.0:1789403252.609932:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714624 00000100:00100000:2.0:1789403252.609968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789403252.609976:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050714624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403252.610119:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050714624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.610126:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789403252.610452:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.610559:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.610611:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.610635:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.610698:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714752 00000100:00100000:2.0:1789403252.610704:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714752 00000100:00100000:2.0:1789403252.610736:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789403252.610744:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050714752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403252.610831:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050714752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.610839:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789403252.610915:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789403252.614273:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789403252.615536:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789403252.615575:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403252.615589:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.615605:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403252.615617:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403252.615620:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b11800 from 7 10000000:01000000:1.0:1789403252.615623:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403252.615673:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.615682:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.615705:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403252.615738:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.615841:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.615898:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.616105:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050714880 00000100:00100000:2.0:1789403252.616116:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050714880 00000100:00100000:2.0:1789403252.616181:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789403252.616192:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050714880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403252.616209:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403252.616224:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760cec expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.616254:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.616267:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.616277:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a26e00, rc 0) 00000100:00100000:2.0:1789403252.616346:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050714880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.616353:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789403252.616517:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050714880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403252.616537:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403252.616547:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403252.616620:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403252.616651:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403252.616683:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149840 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.616963:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715008 00000100:00100000:2.0:1789403252.616969:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715008 00000100:00100000:2.0:1789403252.617009:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789403252.617028:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050715008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403252.617153:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050715008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.617160:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789403252.617547:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403252.617593:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403252.617650:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403252.617683:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149840 going to sleep for 11 seconds 00000100:00100000:3.0:1789403252.617789:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715136 00000100:00100000:3.0:1789403252.617795:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715136 00000100:00100000:3.0:1789403252.617832:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789403252.617839:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050715136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403252.617947:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050715136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403252.617954:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789403252.619591:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789403252.622428:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789403252.622660:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789403252.622687:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403252.622701:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.622715:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403252.622728:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403252.622731:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a244ea0000 from 7 10000000:01000000:1.0:1789403252.622734:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403252.622781:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.622790:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.622802:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403252.622833:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.622914:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.622975:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.623760:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715264 00000100:00100000:2.0:1789403252.623772:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715264 00000100:00100000:2.0:1789403252.623826:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789403252.623837:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050715264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403252.623867:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403252.623883:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760cfa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.623916:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.623929:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403252.623938:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a26400, rc 0) 00000100:00100000:2.0:1789403252.624010:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050715264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.624018:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789403252.624057:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403252.624077:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403252.624087:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403252.624167:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.624206:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.624238:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403252.624266:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715392 00000100:00100000:2.0:1789403252.624270:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715392 00000100:00100000:2.0:1789403252.624350:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789403252.624358:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050715392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403252.624597:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050715392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403252.624604:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789403252.627088:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.627165:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.627250:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.627294:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403252.627322:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715520 00000100:00100000:1.0:1789403252.627330:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715520 00000100:00100000:1.0:1789403252.627805:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789403252.627819:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050715520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403252.628105:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050715520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403252.628116:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789403252.628157:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050715520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789403252.629893:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789403252.630075:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789403252.630104:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789403252.630117:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403252.630132:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403252.978087:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403252.978118:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050715648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403252.978206:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403252.978230:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715648 00000100:00100000:1.0:1789403252.978241:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715648 00000100:00100000:1.0:1789403252.978292:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789403252.978315:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050715648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403252.978371:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403252.978451:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050715648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403252.978459:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789403252.978524:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050715648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403253.236554:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403254.004012:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050715776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403254.004083:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403254.004169:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715776 00000100:00100000:2.0:1789403254.004177:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715776 00000100:00100000:2.0:1789403254.004224:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789403254.004233:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050715776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403254.004266:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403254.004322:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050715776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403254.004329:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789403254.004376:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050715776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403254.257523:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403254.514532:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403254.514555:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050715904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403254.514620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.514682:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050715904 00000100:00100000:1.0:1789403254.514689:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050715904 00000100:00100000:1.0:1789403254.514741:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789403254.514749:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050715904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403254.514777:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403254.514818:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050715904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.514824:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789403254.514843:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789403254.514868:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64bb80 x1876325050715904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403254.514886:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050715904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403254.519893:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050716288:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.519963:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.519997:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050716800:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.520022:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.520039:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050717312:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.520059:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.520099:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789403254.520105:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050716160:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.520126:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.520143:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050716672:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.520162:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.520178:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050717184:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.520197:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.520227:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716800 00000100:00100000:1.0:1789403254.520233:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716800 00000100:00100000:1.0:1789403254.520282:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717312 00000100:00100000:1.0:1789403254.520286:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717312 00000100:00100000:1.0:1789403254.520323:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789403254.520332:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050716800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.520381:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050716800:12345-0@lo:400:kworker.0 Request processed in 51us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.520407:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789403254.520424:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789403254.520430:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050717312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521007:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050717312:12345-0@lo:400:kworker.0 Request processed in 574us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521015:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789403254.521044:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716288 00000100:00100000:1.0:1789403254.521049:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716288 00000100:00100000:1.0:1789403254.521068:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716160 00000100:00100000:1.0:1789403254.521070:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716160 00000100:00100000:1.0:1789403254.521079:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716672 00000100:00100000:1.0:1789403254.521082:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716672 00000100:00100000:1.0:1789403254.521093:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717184 00000100:00100000:1.0:1789403254.521100:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717184 00000100:00100000:1.0:1789403254.521117:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789403254.521122:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050716288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521153:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050716288:12345-0@lo:400:kworker.0 Request processed in 31us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521158:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789403254.521167:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789403254.521172:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050716160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521191:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050716160:12345-0@lo:400:kworker.0 Request processed in 20us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521196:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789403254.521205:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789403254.521210:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050716672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521233:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050716672:12345-0@lo:400:kworker.0 Request processed in 24us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521239:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789403254.521249:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789403254.521254:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050717184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521278:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050717184:12345-0@lo:400:kworker.0 Request processed in 24us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521283:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1789403254.521314:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403254.521317:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403254.521319:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403254.521337:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050716032:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521365:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.521416:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050716544:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521439:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.521544:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050717056:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521566:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403254.521575:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050716416:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521593:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716032 00000100:00100000:1.0:1789403254.521597:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716032 00000100:00100000:1.0:1789403254.521622:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789403254.521629:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050716032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521778:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050716032:12345-0@lo:400:kworker.0 Request processed in 148us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521785:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789403254.521809:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716544 00000100:00100000:1.0:1789403254.521812:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716544 00000100:00100000:1.0:1789403254.521836:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717056 00000100:00100000:1.0:1789403254.521838:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717056 00000100:00100000:1.0:1789403254.521851:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789403254.521857:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050716544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521884:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050716544:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521889:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789403254.521900:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789403254.521905:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050717056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521927:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050717056:12345-0@lo:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.521932:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1789403254.521943:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403254.521964:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050716032:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.521985:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050716544:0@lo:400:kworker.0 00000100:00100000:3.0:1789403254.521986:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.521994:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050717056:0@lo:400:kworker.0 00000100:00100000:1.0:1789403254.522009:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403254.522015:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050717440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403254.522038:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403254.522061:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717440 00000100:00100000:1.0:1789403254.522065:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717440 00000100:00100000:1.0:1789403254.522088:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789403254.522094:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050717440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403254.522110:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403254.522140:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050717440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403254.522145:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1789403254.522170:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143698700 x1876325050717440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403254.522184:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050717440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403254.524959:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050716928:0@lo:400:kworker.0 00000100:00100000:3.0:1789403254.525031:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403254.525093:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716928 00000100:00100000:3.0:1789403254.525101:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716928 00000100:00100000:3.0:1789403254.525153:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789403254.525161:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050716928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403254.525334:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050716928:12345-0@lo:400:kworker.0 Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403254.525341:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1789403254.525365:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403254.525545:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aae680 x1876325050716928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403254.525559:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050716928:0@lo:400:kworker.0 00000100:00100000:0.0:1789403254.525696:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050716416 00000100:00100000:0.0:1789403254.525702:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050716416 00000100:00100000:0.0:1789403254.525863:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789403254.525872:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050716416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403254.525922:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050716416:12345-0@lo:400:kworker.0 Request processed in 52us (3936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403254.525929:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789403254.525997:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050716416:0@lo:400:kworker.0 00000100:00100000:2.0:1789403254.526332:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050716160:0@lo:400:kworker.0 00010000:00080000:2.0:1789403254.526347:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64a680 x1876325050716672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403254.526356:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050716672:0@lo:400:kworker.0 00010000:00080000:2.0:1789403254.526366:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143513800 x1876325050717184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403254.526372:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050717184:0@lo:400:kworker.0 00000100:00100000:2.0:1789403254.526383:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050716288:0@lo:400:kworker.0 00010000:00080000:2.0:1789403254.526596:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649500 x1876325050716800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403254.526697:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050716800:0@lo:400:kworker.0 00010000:00080000:2.0:1789403254.526713:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143512300 x1876325050717312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403254.526732:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050717312:0@lo:400:kworker.0 00000001:02000400:3.0:1789403255.103577:0:13366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789403255.282807:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403256.305592:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403257.329777:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403257.418800:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403257.418849:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403257.418883:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403257.418914:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403257.418944:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403257.418980:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050816 00000100:00100000:0.0:1789403257.418991:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050816 00000100:00100000:0.0:1789403257.419044:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038051072 00000100:00100000:0.0:1789403257.419047:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038051072 00000100:00100000:0.0:1789403257.419061:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050688 00000100:00100000:0.0:1789403257.419064:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050688 00000100:00100000:0.0:1789403257.419075:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050944 00000100:00100000:0.0:1789403257.419078:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050944 00000100:00100000:0.0:1789403257.419095:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:0.0:1789403257.419105:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038050816:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403257.419187:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038050816:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403257.419195:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:0.0:1789403257.419212:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:0.0:1789403257.419218:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038051072:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403257.419264:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038051072:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 45us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403257.419282:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:0.0:1789403257.419295:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:0.0:1789403257.419301:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038050688:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403257.419326:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038050688:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403257.419333:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:0.0:1789403257.419344:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:0.0:1789403257.419351:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038050944:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403257.419375:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038050944:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403257.419381:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00080000:0.0:1789403257.419431:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403257.419436:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403257.420243:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038050560 00000100:00100000:2.0:1789403257.420252:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038050560 00000100:00100000:2.0:1789403257.420338:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 332 00000100:00100000:2.0:1789403257.420346:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2390:x1876325038050560:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403257.420381:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2390:x1876325038050560:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403257.420422:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 332 00000100:00100000:2.0:1789403257.589931:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050717568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403257.590006:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403257.590380:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717568 00000100:00100000:3.0:1789403257.590414:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717568 00000100:00100000:3.0:1789403257.590468:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789403257.590495:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050717568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403257.590523:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403257.590571:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050717568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403257.590578:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789403257.590647:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403257.590691:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403257.590703:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050717696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403257.590733:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403257.590774:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717696 00000100:00100000:1.0:1789403257.590778:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717696 00000100:00100000:1.0:1789403257.590815:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403257.590821:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050717696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403257.590831:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403257.590861:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050717696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403257.590874:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789403257.590910:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251d880 x1876325050717696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403257.590929:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050717696:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789403257.591158:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789403257.591304:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143512300 x1876325050717568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403257.591318:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050717568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403258.097676:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403258.097699:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050717824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403258.097771:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403258.098417:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717824 00000100:00100000:2.0:1789403258.098427:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717824 00000100:00100000:2.0:1789403258.098484:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789403258.098494:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050717824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403258.098527:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403258.098595:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050717824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403258.098602:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789403258.098907:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050717824:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789403258.353587:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403259.123860:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050717952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403259.123942:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403259.124244:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050717952 00000100:00100000:3.0:1789403259.124253:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050717952 00000100:00100000:3.0:1789403259.124315:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789403259.124325:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050717952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403259.124366:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403259.124447:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050717952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403259.124455:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789403259.124498:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050717952:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789403259.379842:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403259.635118:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403259.635143:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050718080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403259.635212:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403259.635299:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718080 00000100:00100000:1.0:1789403259.635307:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718080 00000100:00100000:1.0:1789403259.635374:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403259.635384:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050718080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403259.635446:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403259.635498:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050718080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403259.635505:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789403259.635644:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050718208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403259.635673:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403259.635722:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718208 00000100:00100000:0.0:1789403259.635726:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718208 00000100:00100000:0.0:1789403259.635752:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789403259.635758:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050718208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403259.635786:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403259.635815:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050718208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403259.635821:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1789403259.635850:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a28183ad80 x1876325050718208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403259.635868:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050718208:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789403259.636146:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a28183a300 x1876325050718080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403259.636159:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050718080:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789403259.636191:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403259.638299:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050718336:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.638369:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403259.638446:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050718848:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.638502:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403259.638523:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050719360:0@lo:400:kworker.0 00000100:00100000:1.0:1789403259.638914:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718336 00000100:00100000:1.0:1789403259.638924:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718336 00000100:00100000:1.0:1789403259.638971:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789403259.638980:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050718336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403259.639030:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050718336:12345-0@lo:400:kworker.0 Request processed in 52us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403259.639057:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789403259.639102:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718848 00000100:00100000:1.0:1789403259.639106:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718848 00000100:00100000:1.0:1789403259.639141:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789403259.639148:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050718848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403259.639180:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050718848:12345-0@lo:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403259.639186:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1789403259.639201:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403259.639275:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403259.639321:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050718336:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.639334:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050718848:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.639348:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789403259.639355:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050718720:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.639631:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403259.639651:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050719232:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.639677:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403259.639874:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719232 00000100:00100000:0.0:1789403259.639879:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719232 00000100:00100000:0.0:1789403259.639918:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789403259.639926:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050719232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.639969:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050719232:12345-0@lo:400:kworker.0 Request processed in 45us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403259.639976:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789403259.639996:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403259.640015:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143597480 x1876325050719232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403259.640026:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050719232:0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640114:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050718592:0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640151:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403259.640177:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050719104:0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640199:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403259.640216:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789403259.640221:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050718464:0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640239:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403259.640268:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050718976:0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640288:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403259.640305:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050719488:0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640323:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403259.640342:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719360 00000100:00100000:2.0:1789403259.640346:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719360 00000100:00100000:2.0:1789403259.640372:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718592 00000100:00100000:2.0:1789403259.640375:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718592 00000100:00100000:2.0:1789403259.640425:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718464 00000100:00100000:2.0:1789403259.640428:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718464 00000100:00100000:2.0:1789403259.640441:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718976 00000100:00100000:2.0:1789403259.640443:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718976 00000100:00100000:2.0:1789403259.640454:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719488 00000100:00100000:2.0:1789403259.640467:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719488 00000100:00100000:2.0:1789403259.640482:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789403259.640488:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050719360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403259.640528:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050719360:12345-0@lo:400:kworker.0 Request processed in 40us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403259.640534:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789403259.641172:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719104 00000100:00100000:3.0:1789403259.641178:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719104 00000100:00100000:3.0:1789403259.641208:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789403259.641214:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050719104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403259.641266:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050719104:12345-0@lo:400:kworker.0 Request processed in 53us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403259.641284:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789403259.641338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050718720 00000100:00100000:3.0:1789403259.641341:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050718720 00000100:00100000:3.0:1789403259.641363:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789403259.641370:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050718720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403259.641426:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050718720:12345-0@lo:400:kworker.0 Request processed in 57us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403259.641432:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1789403259.641472:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a64bb80 x1876325050719104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403259.641483:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050719104:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641560:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789403259.641569:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050718592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641606:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050718592:12345-0@lo:400:kworker.0 Request processed in 39us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403259.641612:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789403259.641625:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789403259.641631:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050718464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641657:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050718464:12345-0@lo:400:kworker.0 Request processed in 26us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403259.641663:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789403259.641674:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789403259.641680:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050718976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641706:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050718976:12345-0@lo:400:kworker.0 Request processed in 27us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403259.641712:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789403259.641723:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789403259.641729:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050719488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641765:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050719488:12345-0@lo:400:kworker.0 Request processed in 36us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403259.641771:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789403259.641792:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050718464:0@lo:400:kworker.0 00010000:00080000:0.0:1789403259.641801:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649180 x1876325050718976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403259.641810:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050718976:0@lo:400:kworker.0 00010000:00080000:0.0:1789403259.641818:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143596d80 x1876325050719488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403259.641826:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050719488:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641833:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050718592:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641855:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050718720:0@lo:400:kworker.0 00000100:00100000:0.0:1789403259.641865:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050719360:0@lo:400:kworker.0 00000100:00080000:0.0:1789403259.641958:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403259.641962:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403259.641964:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789403260.379650:0:13515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:27:39 (1789403259) === 00010000:00010000:0.0:1789403260.403539:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403260.606868:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.606964:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.606997:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038051200 00000100:00100000:3.0:1789403260.607007:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038051200 00000100:00100000:3.0:1789403260.607131:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1789403260.607143:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038051200:12345-192.168.203.43@tcp:41:mkdir.0 00000004:00000024:3.0:1789403260.607180:0:9061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403260.607277:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038051200:12345-192.168.203.43@tcp:41:mkdir.0 Request processed in 137us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403260.607285:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:3.0:1789403260.607312:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038051328 00000100:00100000:3.0:1789403260.607316:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038051328 00000100:00100000:3.0:1789403260.607349:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1789403260.607356:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:10486:x1876325038051328:12345-192.168.203.43@tcp:700:mkdir.0 00000100:00100000:3.0:1789403260.607419:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:10486:x1876325038051328:12345-192.168.203.43@tcp:700:mkdir.0 Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403260.607425:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00080000:0.0:1789403260.616736:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403260.627519:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.627724:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038051584 00000100:00100000:1.0:1789403260.627734:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038051584 00000100:00100000:1.0:1789403260.627835:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1789403260.627847:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:10486:x1876325038051584:12345-192.168.203.43@tcp:36:mkdir.0 00010000:00010000:1.0:1789403260.627899:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403260.627977:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b760baa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12862d expref: 6 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.627998:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2466b6400) 00010000:00010000:1.0:1789403260.628010:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403260.628104:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.628119:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.628129:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.628180:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.628188:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.628196:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.628995:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629007:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629015:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403260.629029:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091167f94 reply state 000000009b4d03f0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629050:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629056:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:1.0:1789403260.629059:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403260.629062:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789403260.629067:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789403260.629074:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629081:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629095:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629101:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.629105:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629114:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629123:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1425ebb00) 00010000:00010000:1.0:1789403260.629125:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403260.629129:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629135:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403260.629150:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091167f94 reply state 000000009b4d03f0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629159:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.629164:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a1425eb100) 00010000:00010000:1.0:1789403260.629167:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403260.629168:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789403260.629273:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:10486:x1876325038051584:12345-192.168.203.43@tcp:36:mkdir.0 Request processed in 1427us (1762us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789403260.629281:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403260.646186:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403260.646227:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038051712 00000100:00100000:0.0:1789403260.646239:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038051712 00000100:00100000:0.0:1789403260.646302:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1789403260.646312:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:10487:x1876325038051712:12345-192.168.203.43@tcp:101:chmod.0 00010000:00010000:0.0:1789403260.646350:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403260.646370:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286c0 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.646466:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760d24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.646480:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.646492:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403260.646539:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403260.646542:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403260.646580:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760d24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.646606:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286c0 expref: 9 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.646621:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760d24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286c0 expref: 8 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.646629:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a242c22800) 00010000:00010000:0.0:1789403260.646631:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403260.646635:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0200, rc 0) 00000100:00100000:0.0:1789403260.646693:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:10487:x1876325038051712:12345-192.168.203.43@tcp:101:chmod.0 Request processed in 382us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403260.646700:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1789403260.651234:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.651345:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038051968 00000100:00100000:3.0:1789403260.651362:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038051968 00000100:00100000:3.0:1789403260.651481:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403260.651493:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:10487:x1876325038051968:12345-192.168.203.43@tcp:36:chmod.0 00010000:00010000:3.0:1789403260.651562:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403260.651948:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760d24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286c0 expref: 8 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.652109:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a242c22800) 00010000:00010000:3.0:1789403260.652125:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403260.652162:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.652179:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.652192:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403260.652500:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000136ee6bf reply state 0000000094d656a8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.652516:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.652535:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:3.0:1789403260.652538:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789403260.652542:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789403260.652552:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789403260.652949:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:10487:x1876325038051968:12345-192.168.203.43@tcp:36:chmod.0 Request processed in 1455us (1720us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789403260.653036:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1789403260.689318:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403260.689561:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038052096 00000100:00100000:0.0:1789403260.690205:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038052096 00000100:00100000:0.0:1789403260.690310:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1789403260.690323:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:10488:x1876325038052096:12345-192.168.203.43@tcp:101:chown.0 00010000:00010000:0.0:1789403260.690354:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403260.690444:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286c7 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.690628:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.690652:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.690675:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403260.690746:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403260.690751:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403260.690802:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.690853:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286c7 expref: 11 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.690878:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286c7 expref: 10 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.690887:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:1.0:1789403260.690891:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403260.690894:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04400, rc 0) 00000100:00100000:1.0:1789403260.690973:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:10488:x1876325038052096:12345-192.168.203.43@tcp:101:chown.0 Request processed in 652us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403260.690982:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1789403260.696311:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.696721:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038052224 00000100:00100000:3.0:1789403260.696735:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038052224 00000100:00100000:3.0:1789403260.696940:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1789403260.696954:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:10488:x1876325038052224:12345-192.168.203.43@tcp:101:chown.0 00010000:00010000:3.0:1789403260.696985:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403260.697012:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286ce expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697099:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697118:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697132:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697146:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697154:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697181:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697288:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b760d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697297:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b760d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697305:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b760d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403260.697358:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403260.697363:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403260.697435:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b760d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697452:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697459:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697467:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697473:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403260.697478:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697487:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697508:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:3.0:1789403260.697512:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403260.697518:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697525:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760d47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697541:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697548:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697553:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697560:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403260.697563:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697569:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697587:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a1425eb100) 00010000:00010000:3.0:1789403260.697589:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403260.697593:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697598:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760d4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697640:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ce expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697655:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b760d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ce expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.697662:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:3.0:1789403260.697664:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403260.697667:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184a00, rc 0) 00000100:00100000:3.0:1789403260.697767:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:10488:x1876325038052224:12345-192.168.203.43@tcp:101:chown.0 Request processed in 816us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403260.697782:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1789403260.719862:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.720538:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038052352 00000100:00100000:1.0:1789403260.720549:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038052352 00000100:00100000:1.0:1789403260.720662:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1789403260.720674:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:10488:x1876325038052352:12345-192.168.203.43@tcp:900:chown.0 00000100:00100000:1.0:1789403260.720778:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:10488:x1876325038052352:12345-192.168.203.43@tcp:900:chown.0 Request processed in 107us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403260.720786:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1789403260.727898:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.728008:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038052608 00000100:00100000:3.0:1789403260.728018:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038052608 00000100:00100000:3.0:1789403260.728077:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1789403260.728088:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:10488:x1876325038052608:12345-192.168.203.43@tcp:36:chown.0 00010000:00010000:3.0:1789403260.728142:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403260.728171:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b760d55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ce expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.728192:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:3.0:1789403260.728197:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403260.728219:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.728233:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.728266:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403260.730176:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1789403260.730284:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000447ee542 reply state 00000000974e435d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.730305:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.730314:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:1.0:1789403260.730317:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789403260.730321:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789403260.730333:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1789403260.730501:0:6500:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789403260.730524:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:10488:x1876325038052608:12345-192.168.203.43@tcp:36:chown.0 Request processed in 2435us (2632us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789403260.730533:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00010000:00010000:2.0:1789403260.730873:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.730883:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.730890:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.730896:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403260.730901:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.730909:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730913:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.730920:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:3.0:1789403260.730921:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.730923:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789403260.730926:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730927:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730933:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403260.730934:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b760d5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730935:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730941:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730949:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a1425eb100) 00010000:00010000:3.0:1789403260.730951:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403260.730953:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730959:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730973:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.730984:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731002:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731006:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403260.731009:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731015:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731023:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:3.0:1789403260.731026:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403260.731029:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731035:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731049:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731055:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731207:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731213:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403260.731216:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731233:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731250:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:3.0:1789403260.731253:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789403260.731256:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403260.731262:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b760d2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403260.756384:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.756499:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038052736 00000100:00100000:1.0:1789403260.756510:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038052736 00000100:00100000:1.0:1789403260.756569:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1789403260.756580:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:10489:x1876325038052736:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:1.0:1789403260.756606:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403260.756630:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286d5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789403260.757355:0:6501:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 676us 00010000:00010000:1.0:1789403260.794136:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794157:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794180:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794208:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794215:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794221:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794348:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b760d78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794356:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b760d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794363:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b760d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403260.794421:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403260.794425:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403260.794470:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b760d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794481:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794488:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794502:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794508:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.794512:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794519:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794529:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:1.0:1789403260.794532:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403260.794536:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794542:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b760d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794551:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794557:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794562:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794566:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.794569:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794581:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794587:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a1425ebb00) 00010000:00010000:1.0:1789403260.794589:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403260.794591:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794597:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794637:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b760d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286d5 expref: 8 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794651:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b760d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286d5 expref: 7 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.794658:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:1.0:1789403260.794660:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789403260.794662:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062200, rc 0) 00000100:00100000:1.0:1789403260.794728:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:10489:x1876325038052736:12345-192.168.203.43@tcp:101:touch.500 Request processed in 38149us (38365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403260.794737:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1789403260.813445:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.813522:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038052992 00000100:00100000:1.0:1789403260.813532:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038052992 00000100:00100000:1.0:1789403260.813603:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1789403260.813614:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:10489:x1876325038052992:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:1.0:1789403260.813654:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403260.813676:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d7f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286dc expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.813798:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.813814:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.813826:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.813890:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.813899:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.813906:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403260.814716:0:9061:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789403260.814873:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062600/0x5fb08b1e5b760d94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.814885:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062600/0x5fb08b1e5b760d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.814894:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062600/0x5fb08b1e5b760d94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403260.814912:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190210 00000004:00020000:0.0:1789403260.831214:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190210 00010000:00010000:0.0:1789403260.843926:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845140:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845152:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845158:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403260.845163:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845172:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845209:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:0.0:1789403260.845212:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403260.845217:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845224:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b760d86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403260.845253:0:9061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaefadf1 reply state 0000000036f44273 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845266:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845274:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a1425ebb00) 00010000:00010000:0.0:1789403260.845276:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403260.845280:0:9061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789403260.845337:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b760d7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286dc expref: 10 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845354:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062600/0x5fb08b1e5b760d94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286dc expref: 9 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.845362:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a1425eb900) 00010000:00010000:0.0:1789403260.845364:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403260.845366:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062600, rc 0) 00000100:00100000:0.0:1789403260.845470:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:10489:x1876325038052992:12345-192.168.203.43@tcp:101:touch.500 Request processed in 31857us (32033us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789403260.845478:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:2.0:1789403260.868368:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.868503:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038053248 00000100:00100000:3.0:1789403260.868513:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038053248 00000100:00100000:2.0:1789403260.868900:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1789403260.868914:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:10489:x1876325038053248:12345-192.168.203.43@tcp:36:touch.500 00010000:00010000:2.0:1789403260.868974:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403260.869001:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062600/0x5fb08b1e5b760d94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286dc expref: 10 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.869038:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a1425eb900) 00010000:00010000:2.0:1789403260.869048:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403260.869107:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.869121:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.869131:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403260.869254:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af23abfc reply state 00000000ae43bff8 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.869266:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.869272:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:2.0:1789403260.869275:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403260.869278:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403260.869370:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:10489:x1876325038053248:12345-192.168.203.43@tcp:36:touch.500 Request processed in 460us (1012us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789403260.869378:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:1.0:1789403260.873813:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403260.873893:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038053376 00000100:00100000:2.0:1789403260.873903:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038053376 00000100:00100000:2.0:1789403260.873960:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1789403260.873970:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:10489:x1876325038053376:12345-192.168.203.43@tcp:101:touch.500 00010000:00010000:2.0:1789403260.873993:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403260.874028:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27600/0x5fb08b1e5b760da9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286e3 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.874082:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27600/0x5fb08b1e5b760da9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286e3 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.874098:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27600/0x5fb08b1e5b760da9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286e3 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.874118:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:2.0:1789403260.874122:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403260.874125:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27600, rc 0) 00000100:00100000:2.0:1789403260.874189:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:10489:x1876325038053376:12345-192.168.203.43@tcp:101:touch.500 Request processed in 220us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403260.874197:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:0.0:1789403260.881789:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.881887:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038053504 00000100:00100000:1.0:1789403260.881896:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038053504 00000100:00100000:1.0:1789403260.882046:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1789403260.882058:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2386:x1876325038053504:12345-192.168.203.43@tcp:8:touch.500 00010000:00080000:1.0:1789403260.882093:0:8416:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1789403260.882123:0:8416:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b760db0 00002000:00100000:1.0:1789403260.882135:0:8416:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4/ffff90a277bde000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789403260.882152:0:8416:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789403260.882224:0:8416:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789403260.882287:0:8416:0:(import.c:65:import_set_state_nolock()) ffff90a1436b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403260.882358:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038053504:12345-192.168.203.43@tcp:8:touch.500 Request processed in 301us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403260.882366:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1789403260.884286:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403260.884374:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038053632 00000100:00100000:3.0:1789403260.884382:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038053632 00000100:00100000:3.0:1789403260.884476:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403260.884487:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038053632:12345-192.168.203.43@tcp:2:touch.500 00000100:00080000:0.0:1789403260.884540:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789403260.895560:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789403260.895574:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000100:00100000:3.0:1789403260.898256:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:0:x1876325038053632:12345-192.168.203.43@tcp:2:touch.500 Request processed in 13750us (13956us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789403260.898270:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1789403260.903524:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.903626:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038053888 00000100:00100000:1.0:1789403260.903636:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038053888 00000100:00100000:1.0:1789403260.903688:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1789403260.903697:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:10489:x1876325038053888:12345-192.168.203.43@tcp:35:touch.500 00000100:00100000:1.0:1789403260.904005:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:10489:x1876325038053888:12345-192.168.203.43@tcp:35:touch.500 Request processed in 308us (490us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789403260.904013:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1789403260.919352:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403260.919448:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038054016 00000100:00100000:2.0:1789403260.919458:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038054016 00000100:00100000:2.0:1789403260.919517:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1789403260.919527:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:10490:x1876325038054016:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:2.0:1789403260.919550:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403260.919570:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27a00/0x5fb08b1e5b760db7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286ea expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.919632:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27200/0x5fb08b1e5b760dbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.919646:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27200/0x5fb08b1e5b760dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.919673:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27200/0x5fb08b1e5b760dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403260.919722:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789403260.919726:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403260.919761:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27200/0x5fb08b1e5b760dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.919785:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27a00/0x5fb08b1e5b760db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ea expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.919800:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27200/0x5fb08b1e5b760dbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ea expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.919808:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:2.0:1789403260.919810:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403260.919814:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a260a27200, rc 0) 00000100:00100000:2.0:1789403260.919878:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:10490:x1876325038054016:12345-192.168.203.43@tcp:101:rm.0 Request processed in 351us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403260.919885:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1789403260.927055:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.927179:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038054272 00000100:00100000:1.0:1789403260.927189:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038054272 00000100:00100000:1.0:1789403260.927273:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1789403260.927285:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:10490:x1876325038054272:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:1.0:1789403260.927306:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403260.927327:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286f1 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403260.927477:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789403260.927621:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760dc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286f1 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.927635:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:1.0:1789403260.927639:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403260.927644:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286f1 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.927657:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062000, rc 0) 00000100:00100000:1.0:1789403260.927707:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:10490:x1876325038054272:12345-192.168.203.43@tcp:101:rm.0 Request processed in 425us (661us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789403260.927713:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1789403260.933163:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.933364:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038054400 00000100:00100000:1.0:1789403260.933374:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038054400 00000100:00100000:1.0:1789403260.933464:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1789403260.933474:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:10490:x1876325038054400:12345-192.168.203.43@tcp:37:rm.0 00000100:00100000:1.0:1789403260.939735:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:10490:x1876325038054400:12345-192.168.203.43@tcp:37:rm.0 Request processed in 6252us (6572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403260.939748:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1789403260.951462:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403260.952292:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038054656 00000100:00100000:0.0:1789403260.952306:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038054656 00000100:00100000:0.0:1789403260.952381:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1789403260.952435:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:10490:x1876325038054656:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:0.0:1789403260.952687:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:10490:x1876325038054656:12345-192.168.203.43@tcp:35:rm.0 Request processed in 295us (1234us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789403260.952694:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1789403260.955532:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403260.955766:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038054912 00000100:00100000:2.0:1789403260.955776:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038054912 00000100:00100000:2.0:1789403260.955852:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1789403260.955864:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:10490:x1876325038054912:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:2.0:1789403260.955897:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403260.955936:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27a00/0x5fb08b1e5b760dd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286f8 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.956079:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b760dda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.956094:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b760dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.956107:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b760dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403260.956120:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789403260.956234:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27a00/0x5fb08b1e5b760dd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286f8 expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.956265:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b760dda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286f8 expref: 18 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.956275:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:2.0:1789403260.956278:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789403260.956282:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7a00, rc 0) 00000100:00100000:2.0:1789403260.956350:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038054912:12345-192.168.203.43@tcp:101:rm.0 Request processed in 489us (828us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789403260.956357:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1789403260.959015:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.959112:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038055040 00000100:00100000:1.0:1789403260.959137:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038055040 00000100:00100000:1.0:1789403260.959195:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1789403260.959206:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038055040:12345-192.168.203.43@tcp:41:rm.0 00000004:00000024:1.0:1789403260.959271:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1789403260.959347:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038055040:12345-192.168.203.43@tcp:41:rm.0 Request processed in 142us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403260.959355:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1789403260.962136:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403260.962301:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038055168 00000100:00100000:2.0:1789403260.962312:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038055168 00000100:00100000:2.0:1789403260.962370:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1789403260.962380:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038055168:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:2.0:1789403260.962441:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403260.962462:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b760de8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1286ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962524:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962538:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962550:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962562:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962569:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962577:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962805:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962814:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962821:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403260.962855:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789403260.962865:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403260.962887:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962899:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962907:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962914:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962920:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962927:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403260.962931:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.962939:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963182:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:2.0:1789403260.963187:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403260.963193:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963201:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b760def lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963216:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963233:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963250:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963255:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403260.963259:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963266:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963274:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a1425ebb00) 00010000:00010000:2.0:1789403260.963277:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403260.963280:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963287:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760df6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963316:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b760de8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ff expref: 20 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963329:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ff expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403260.963336:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:2.0:1789403260.963338:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403260.963348:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6400, rc 0) 00000100:00100000:2.0:1789403260.963460:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:10490:x1876325038055168:12345-192.168.203.43@tcp:101:rm.0 Request processed in 1081us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403260.963467:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1789403260.966941:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.967334:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038055424 00000100:00100000:1.0:1789403260.967344:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038055424 00000100:00100000:1.0:1789403260.967486:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1789403260.967496:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:10490:x1876325038055424:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:1.0:1789403260.967548:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789403260.967572:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b760dfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ff expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967593:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27600/0x5fb08b1e5b760da9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286e3 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967616:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:1.0:1789403260.967634:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27200/0x5fb08b1e5b760dbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286ea expref: 17 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967643:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:1.0:1789403260.967646:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403260.967668:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967681:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967707:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967719:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967727:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967733:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967833:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967842:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.967849:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403260.968077:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789403260.968087:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306966696947ns, next at 307966694620ns, rc = 0 00010000:00010000:1.0:1789403260.968123:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968130:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968137:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968152:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968158:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968163:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968185:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403260.968202:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968207:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968214:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968218:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.968223:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968229:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968237:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:1.0:1789403260.968249:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789403260.968254:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968268:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e12 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968284:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968290:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968295:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968299:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.968302:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968307:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968314:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:1.0:1789403260.968316:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403260.968318:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968323:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403260.968330:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f55520d3 reply state 000000000583a049 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968344:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.968356:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a1425ebb00) 00010000:00010000:1.0:1789403260.968359:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403260.968361:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403260.968463:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038055424:12345-192.168.203.43@tcp:36:rm.0 Request processed in 967us (1530us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789403260.968471:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00010000:00010000:0.0:1789403260.968610:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403260.968616:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.968623:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403260.968625:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.968632:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.968640:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:0.0:1789403260.968642:0:8431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789403260.968645:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.968662:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062a00/0x5fb08b1e5b760e19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403260.968671:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403260.968673:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403260.968674:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403260.972686:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.972771:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038055680 00000100:00100000:1.0:1789403260.972783:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038055680 00000100:00100000:1.0:1789403260.972840:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1789403260.972851:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038055680:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:1.0:1789403260.973089:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:10490:x1876325038055680:12345-192.168.203.43@tcp:35:rm.0 Request processed in 238us (413us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789403260.973097:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1789403260.976553:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403260.976732:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038055936 00000100:00100000:1.0:1789403260.976743:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038055936 00000100:00100000:1.0:1789403260.976803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:1.0:1789403260.976814:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:10490:x1876325038055936:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:1.0:1789403260.976917:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789403260.976944:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b760dda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286f8 expref: 19 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977025:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b760d78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286d5 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977036:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb400) 00010000:00010000:1.0:1789403260.977051:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b760d39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286c7 expref: 17 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977074:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8700) 00010000:00010000:1.0:1789403260.977080:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403260.977100:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977112:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977122:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977132:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977138:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977144:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977223:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977230:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977237:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403260.977723:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789403260.977738:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977752:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977759:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977765:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.977770:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977777:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977786:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a1425eb200) 00010000:00010000:1.0:1789403260.977788:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789403260.977792:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977798:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062c00/0x5fb08b1e5b760e2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977816:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977823:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977829:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977834:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403260.977843:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977850:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977859:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1425ebf00) 00010000:00010000:1.0:1789403260.977861:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403260.977864:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977870:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b760e20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403260.977882:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc446439 reply state 00000000d2aa126a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977893:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403260.977900:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a1425eb500) 00010000:00010000:1.0:1789403260.977902:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403260.977905:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403260.978137:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:10490:x1876325038055936:12345-192.168.203.43@tcp:36:rm.0 Request processed in 1322us (1592us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789403260.978146:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00010000:00010000:2.0:1789403261.426501:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403262.450446:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403262.537357:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403262.537422:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056064 00000100:00100000:0.0:1789403262.537433:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056064 00000100:00100000:2.0:1789403262.537443:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403262.537481:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403262.537498:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 334 00000100:00100000:2.0:1789403262.537509:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403262.537534:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403262.537564:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403262.537584:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056320 00000100:00100000:2.0:1789403262.537588:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056320 00000100:00100000:2.0:1789403262.537623:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056576 00000100:00100000:2.0:1789403262.537626:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056576 00000100:00100000:2.0:1789403262.537643:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056192 00000100:00100000:2.0:1789403262.537645:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056192 00000100:00100000:2.0:1789403262.537658:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056704 00000100:00100000:2.0:1789403262.537660:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056704 00000100:00100000:2.0:1789403262.537675:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:2.0:1789403262.537683:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038056320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403262.537749:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038056320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 67us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403262.537756:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:2.0:1789403262.537773:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:2.0:1789403262.537780:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038056576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403262.537790:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038056064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403262.537823:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038056064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 316us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403262.537832:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 334 00000100:00100000:2.0:1789403262.537838:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038056576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 57us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403262.537847:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:2.0:1789403262.537865:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:2.0:1789403262.537873:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2387:x1876325038056192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:0.0:1789403262.537880:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403262.537885:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403262.537897:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056448 00000100:00100000:0.0:1789403262.537902:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056448 00000100:00100000:2.0:1789403262.537903:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2387:x1876325038056192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403262.537912:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:2.0:1789403262.537925:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:2.0:1789403262.537931:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038056704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403262.537963:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038056704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403262.537969:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00080000:2.0:1789403262.538712:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403262.539110:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:0.0:1789403262.539126:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038056448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403262.539192:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038056448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 72us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403262.539199:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000004:00080000:1.0:1789403262.705945:0:8561:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308704553229ns, next at 309704550762ns, rc = 0 00000100:00100000:1.0:1789403262.705981:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403262.706000:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050719616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403262.706111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403262.706187:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719616 00000100:00100000:1.0:1789403262.706204:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719616 00000100:00100000:1.0:1789403262.709171:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789403262.709185:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050719616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403262.709219:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403262.709306:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050719616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403262.709313:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1789403262.709372:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143594700 x1876325050719616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403262.709415:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050719616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403262.710288:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050719744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403262.710338:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403262.710403:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719744 00000100:00100000:0.0:1789403262.710417:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719744 00000100:00100000:0.0:1789403262.710456:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789403262.710463:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050719744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403262.710479:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403262.710517:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050719744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403262.710523:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789403262.710557:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2df80 x1876325050719744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403262.710571:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050719744:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789403262.711250:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403263.217714:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403263.217737:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050719872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403263.217805:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403263.217924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050719872 00000100:00100000:2.0:1789403263.217946:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050719872 00000100:00100000:2.0:1789403263.218142:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789403263.218153:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050719872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403263.218187:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403263.218263:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050719872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403263.218270:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789403263.218380:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050719872:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403263.474018:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403264.242063:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050720000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403264.242137:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403264.242214:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720000 00000100:00100000:2.0:1789403264.242231:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720000 00000100:00100000:2.0:1789403264.242296:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789403264.242321:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050720000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403264.242356:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403264.253361:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050720000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11031us (11213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.253375:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789403264.253379:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050720000:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403264.498478:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403264.756251:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050720512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756319:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756368:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050721024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756415:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756433:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050721536:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756455:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756489:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789403264.756495:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050720128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756521:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756548:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050720640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756572:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756599:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050721152:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756632:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756660:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050720256:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756683:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756700:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050720768:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756718:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756732:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050721280:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756749:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756761:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789403264.756765:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050720384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756782:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756791:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050720896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756807:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756822:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050721408:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.756840:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403264.756872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720512 00000100:00100000:1.0:1789403264.756879:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720512 00000100:00100000:1.0:1789403264.756934:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789403264.756942:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050720512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.757124:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050720512:12345-0@lo:400:kworker.0 Request processed in 181us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403264.757131:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789403264.757156:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721024 00000100:00100000:1.0:1789403264.757160:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721024 00000100:00100000:1.0:1789403264.757184:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721536 00000100:00100000:1.0:1789403264.757186:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721536 00000100:00100000:1.0:1789403264.757206:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720896 00000100:00100000:1.0:1789403264.757209:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720896 00000100:00100000:1.0:1789403264.757231:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721408 00000100:00100000:1.0:1789403264.757234:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721408 00000100:00100000:1.0:1789403264.757246:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403264.757251:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050721024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.757282:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050721024:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403264.757287:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403264.757299:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403264.757305:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050721536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.757331:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050721536:12345-0@lo:400:kworker.0 Request processed in 27us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403264.757337:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403264.757347:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403264.757352:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050720896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.757382:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050720896:12345-0@lo:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403264.757412:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403264.757424:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789403264.757431:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050721408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.757457:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050721408:12345-0@lo:400:kworker.0 Request processed in 27us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403264.757462:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789403264.757484:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720640 00000100:00100000:1.0:1789403264.757487:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720640 00000100:00100000:1.0:1789403264.757509:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721152 00000100:00100000:1.0:1789403264.757518:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721152 00000100:00100000:1.0:1789403264.757551:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720256 00000100:00100000:1.0:1789403264.757554:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720256 00000100:00100000:1.0:1789403264.757564:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720768 00000100:00100000:1.0:1789403264.757566:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720768 00000100:00100000:1.0:1789403264.757577:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721280 00000100:00100000:1.0:1789403264.757579:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721280 00000100:00100000:1.0:1789403264.757590:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720384 00000100:00100000:1.0:1789403264.757592:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720384 00000100:00100000:1.0:1789403264.757603:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789403264.757702:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050720128 00000100:00100000:2.0:1789403264.757706:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050720128 00000100:00100000:2.0:1789403264.757736:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789403264.757743:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050720128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403264.757779:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050720128:12345-0@lo:400:kworker.0 Request processed in 37us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.757785:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789403264.757815:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789403264.757822:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050721152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403264.757850:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050721152:12345-0@lo:400:kworker.0 Request processed in 29us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.757856:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789403264.757868:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789403264.757874:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050720256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403264.757900:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050720256:12345-0@lo:400:kworker.0 Request processed in 26us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.757911:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789403264.757922:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789403264.757928:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050720768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789403264.758007:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403264.758011:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403264.758013:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403264.758016:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403264.758283:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050720768:12345-0@lo:400:kworker.0 Request processed in 355us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.758301:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789403264.758315:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789403264.758321:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050721280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403264.758351:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050721280:12345-0@lo:400:kworker.0 Request processed in 31us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.758356:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789403264.758367:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789403264.758373:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050720384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.758760:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050720640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403264.759051:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050721664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403264.759228:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403264.759239:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050721792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403264.760018:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050720640:12345-0@lo:400:kworker.0 Request processed in 1263us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403264.760029:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00080000:1.0:1789403264.760096:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143594000 x1876325050720896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403264.760110:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050720896:0@lo:400:kworker.0 00010000:00080000:1.0:1789403264.760122:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fc000 x1876325050721408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403264.760130:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050721408:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.760142:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050720256:0@lo:400:kworker.0 00010000:00080000:1.0:1789403264.760153:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143596300 x1876325050720768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403264.760161:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050720768:0@lo:400:kworker.0 00010000:00080000:1.0:1789403264.760172:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fe300 x1876325050721280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403264.760199:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050721280:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.760260:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050720128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.760272:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050720640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.760282:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050721152:0@lo:400:kworker.0 00000100:00100000:1.0:1789403264.760293:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050720512:0@lo:400:kworker.0 00010000:00080000:1.0:1789403264.760304:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143596d80 x1876325050721024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403264.760313:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050721024:0@lo:400:kworker.0 00010000:00080000:1.0:1789403264.760323:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431ff480 x1876325050721536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403264.760330:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050721536:0@lo:400:kworker.0 00000100:00100000:2.0:1789403264.762093:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050720384:12345-0@lo:400:kworker.0 Request processed in 3711us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.762109:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789403264.763782:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050720384:0@lo:400:kworker.0 00000100:00100000:0.0:1789403264.766185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403264.767067:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721664 00000100:00100000:2.0:1789403264.767079:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721664 00000100:00100000:2.0:1789403264.767141:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789403264.767152:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050721664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403264.767333:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403264.767421:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050721664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 271us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403264.767428:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789403264.767472:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2df80 x1876325050721664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403264.767492:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050721664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403264.767759:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403264.769910:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721792 00000100:00100000:0.0:1789403264.769924:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721792 00000100:00100000:0.0:1789403264.769979:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789403264.769989:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050721792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403264.770012:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403264.770084:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050721792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403264.770091:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789403264.770133:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a277b73800 x1876325050721792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403264.770153:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050721792:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789403265.046658:0:13662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789403265.530715:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789403266.151701:0:13711:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe0fa9010 20000000:00000080:2.0:1789403266.151719:0:13711:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a144030400 uarg=0000000000000000 20000000:01000000:2.0:1789403266.151766:0:13711:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789403266.151778:0:13711:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789403266.151783:0:13711:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789403266.152684:0:13712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789403266.152833:0:13711:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789403266.160254:0:13711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789403266.161960:0:13711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789403266.162003:0:13711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789403266.162023:0:13711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789403266.162044:0:13711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162063:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162072:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162081:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162088:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162095:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162101:0:13711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162116:0:13711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162156:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162174:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.162189:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050721920:0@lo:104: 00000100:00100000:3.0:1789403266.162266:0:13711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403266.162969:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.162981:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 23 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.162993:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a277b70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722048:0@lo:104: 00010000:00010000:3.0:1789403266.163029:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.163038:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.163047:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722176:0@lo:104: 00010000:00010000:3.0:1789403266.163074:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.163082:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.163101:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722304:0@lo:104: 00010000:00010000:3.0:1789403266.163131:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.163144:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 12 pid: 6495 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.163153:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143380a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722432:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403266.163274:0:13711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.163284:0:13711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 12 pid: 6492 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.163294:0:13711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722560:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403266.163324:0:13711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1789403266.165437:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789403266.165480:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789403266.165488:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789403266.165557:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403266.165575:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050722688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789403266.165640:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403266.165696:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050722688 00000100:00100000:2.0:1789403266.165703:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050722688 00000100:00100000:2.0:1789403266.165776:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789403266.165787:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050722688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789403266.165812:0:8417:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:1.0:1789403266.165841:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00002000:00010000:2.0:1789403266.165847:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa8207c, atime: 0x6aa8207c, ctime: 0x6aa8207c, blocks: 0x0 00010000:00010000:2.0:1789403266.165857:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.165868:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403266.165904:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403266.165923:0:6483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403266.165932:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050721920 00000100:00100000:1.0:1789403266.165936:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050721920 00000100:00100000:0.0:1789403266.165947:0:10379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050722048 00000100:00100000:0.0:1789403266.165953:0:10379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050722048 00000100:00100000:1.0:1789403266.165962:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050722176 00000100:00100000:1.0:1789403266.165967:0:6483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050722176 00000100:00100000:0.0:1789403266.165990:0:10379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050722304 00000100:00100000:0.0:1789403266.165994:0:10379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050722304 00010000:00010000:2.0:1789403266.166260:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1789403266.166266:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403266.166414:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166425:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166433:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166439:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403266.166443:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166471:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166489:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a1425ebb00) 00010000:00010000:3.0:1789403266.166492:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403266.166498:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166505:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760d8d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.166522:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403266.166537:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:13711:x1876325050721920:12345-0@lo:104: 00010000:00010000:3.0:1789403266.166541:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166554:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166562:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166563:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166580:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a27800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403266.166585:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403266.166586:0:10379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403266.166596:0:10379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:13711:x1876325050722048:12345-0@lo:104: 00010000:00010000:3.0:1789403266.166602:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.166607:0:10379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166611:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a27c1d8800) 00010000:00010000:3.0:1789403266.166614:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403266.166617:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166633:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a260a27800/0x5fb08b1e5b760da2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166643:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789403266.166654:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.166654:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+6:13711:x1876325050721920:12345-0@lo:104: Request processed in 119us (4385us total) trans 0 rc 0/0 00010000:00010000:0.0:1789403266.166657:0:10379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789403266.166665:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789403266.166678:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166685:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166691:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403266.166695:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166701:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.166710:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a1425ebb00) 00000100:00100000:0.0:1789403266.166710:0:10379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+5:13711:x1876325050722048:12345-0@lo:104: Request processed in 117us (845us total) trans 0 rc 0/0 00010000:00010000:3.0:1789403266.166713:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403266.166716:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403266.166717:0:10379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403266.166733:0:10379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789403266.166739:0:10379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:13711:x1876325050722176:12345-0@lo:104: 00010000:00010000:0.0:1789403266.166747:0:10379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.166786:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789403266.166788:0:10379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789403266.166795:0:10379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:13711:x1876325050722176:12345-0@lo:104: Request processed in 56us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403266.166798:0:6483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+4:13711:x1876325050722304:12345-0@lo:104: 00000100:00100000:0.0:1789403266.166807:0:10379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789403266.166811:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.166828:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789403266.166834:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166851:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789403266.166853:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403266.166859:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.166860:0:6483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+3:13711:x1876325050722304:12345-0@lo:104: Request processed in 66us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403266.166875:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1789403266.166877:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166898:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789403266.166903:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166910:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403266.166913:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166921:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403266.166928:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403266.166941:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403266.166970:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.166978:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403266.166996:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167003:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b760cec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760cf3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167014:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403266.167017:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167022:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403266.167025:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167032:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403266.167037:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403266.167042:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403266.167054:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167060:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403266.167073:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167079:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b05400/0x5fb08b1e5b760cde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760ce5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167089:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403266.167091:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167097:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403266.167100:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167107:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403266.167113:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403266.167119:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789403266.167129:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167133:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167150:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403266.167163:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167167:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.167177:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167179:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b760cd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760cd7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.167211:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167213:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403266.167223:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403266.167227:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403266.167240:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789403266.167416:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050722688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1630us (1775us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789403266.167423:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789403266.167445:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:00010000:0.0:1789403266.167755:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403266.167761:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789403266.167778:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.167785:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403266.167793:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.167799:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b760cfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b760d01 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.167812:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403266.167816:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.167823:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403266.167827:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.167848:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.167858:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403266.167865:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.167873:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050722816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403266.167875:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b760e3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.167898:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403266.167901:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403266.167904:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403266.167917:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403266.167968:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050722816 00000100:00100000:1.0:1789403266.167975:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050722816 00010000:00010000:1.0:1789403266.167997:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 24 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.168022:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789403266.168026:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050722944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403266.168034:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050722816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403266.168046:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403266.168052:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 24 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.168062:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403266.168064:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 24 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.168081:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403266.168100:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050722944 00000100:00100000:2.0:1789403266.168105:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050722944 00000100:00100000:1.0:1789403266.168118:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ffb2a5d6-5856-4505-b5af-5b30dcef2165+25:3628:x1876325050722816:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (200us total) trans 0 rc 0/0 00010000:00010000:2.0:1789403266.168123:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 25 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403266.168125:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403266.168130:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789403266.168154:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789403266.168162:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050722944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403266.168170:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403266.168175:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.168196:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760e0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.168196:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.168229:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403266.168241:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.168250:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.168263:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.168270:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403266.168274:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.168275:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050722944:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (213us total) trans 0 rc 0/0 00010000:00010000:3.0:1789403266.168290:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.168302:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a1425eb500) 00010000:00010000:3.0:1789403266.168305:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403266.168308:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.168314:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760e27 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403266.168345:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050722944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403266.168366:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050721920:0@lo:104: 00010000:00010000:3.0:1789403266.168379:0:13711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a26e00/0x5fb08b1e5b760cf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760cec expref: 24 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403266.169059:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a277b70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722048:0@lo:104: 00000100:00100000:3.0:1789403266.169104:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403266.169172:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403266.169191:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056832 00000100:00100000:3.0:1789403266.169195:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056832 00010000:00010000:3.0:1789403266.169228:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 13 pid: 6495 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.169292:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038056960 00000100:00100000:2.0:1789403266.169296:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038056960 00010000:00010000:2.0:1789403266.169312:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 14 pid: 6492 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.169329:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1789403266.169336:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+14:2390:x1876325038056960:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403266.169346:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403266.169350:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 14 pid: 6492 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.169359:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 14 pid: 6492 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.169371:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403266.169437:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+14:2390:x1876325038056960:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 100us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403266.169444:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1789403266.169475:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050723072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403266.170265:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789403266.170324:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a27a740700/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789403266.170331:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050722688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789403266.170343:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403266.170349:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050723200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403266.170381:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403266.170430:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789403266.173857:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723072 00000100:00100000:3.0:1789403266.173871:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723072 00000100:00100000:1.0:1789403266.173875:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723200 00000100:00100000:1.0:1789403266.173882:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723200 00010000:00010000:3.0:1789403266.173925:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.173925:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.173966:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1789403266.173980:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038056832:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403266.173996:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403266.174003:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 13 pid: 6495 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.174015:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 13 pid: 6495 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403266.174034:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403266.174084:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038056832:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 109us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403266.174470:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403266.174480:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050723200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403266.174490:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403266.174495:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.174817:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789403266.174828:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050723072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403266.174838:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403266.174843:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.174866:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.174995:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.175008:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403266.175068:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050723072:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (5561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403266.175075:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1789403266.175234:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403266.175264:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050723072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403266.175323:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a26400/0x5fb08b1e5b760d01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760cfa expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.175338:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.175346:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.175362:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.175369:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.175375:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.175576:0:13711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184400/0x5fb08b1e5b760ce5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760cde expref: 22 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.175610:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722176:0@lo:104: 00010000:00010000:2.0:1789403266.175624:0:13711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a26600/0x5fb08b1e5b760cd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b760cd0 expref: 21 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.175632:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722304:0@lo:104: 00010000:00010000:2.0:1789403266.175643:0:13711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185600/0x5fb08b1e5b760cc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b9 expref: 13 pid: 6495 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.175651:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143380a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722432:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403266.175662:0:13711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27000/0x5fb08b1e5b760cc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1286b2 expref: 12 pid: 6492 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403266.175680:0:13711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13711:1876325050722560:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403266.176558:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00010000:00010000:3.0:1789403266.176831:0:7451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.176855:0:13711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.176866:0:13711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403266.176873:0:13711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403266.176882:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050722816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403266.178336:0:7451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403266.178346:0:7451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.178359:0:7451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.178371:0:7451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.178380:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e35 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403266.179380:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403266.179865:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3626:x1876325050723200:12345-0@lo:103:ldlm_bl.0 Request processed in 5373us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403266.179883:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789403266.180179:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050723200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403266.545580:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789403267.026904:0:13760:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd46726150 20000000:00000080:1.0:1789403267.026922:0:13760:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a1435df800 uarg=0000000000000000 20000000:01000000:1.0:1789403267.026961:0:13760:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789403267.026968:0:13760:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789403267.026973:0:13760:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789403267.028130:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789403267.028598:0:13760:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1789403267.028683:0:13760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1789403267.028715:0:13760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1789403267.028732:0:13760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1789403267.028743:0:13760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789403267.028763:0:13760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028778:0:13760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028789:0:13760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028795:0:13760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028802:0:13760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028823:0:13760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028830:0:13760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403267.028834:0:13760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028857:0:13760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028870:0:13760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028877:0:13760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.028884:0:13760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403267.441522:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789403267.441531:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a1424b5800 from 7 10000000:01000000:0.0:1789403267.441537:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403267.441590:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.441604:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.441616:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403267.441646:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.441744:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403267.441867:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403267.445141:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723328 00000100:00100000:1.0:1789403267.445450:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723328 00000100:00100000:1.0:1789403267.445740:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789403267.445750:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:6497:x1876325050723328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403267.445766:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403267.445843:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760e4a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.445874:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e4a expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.445887:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e4a expref: 21 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.445896:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062c00, rc 0) 00000100:00100000:1.0:1789403267.446039:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050723328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (4295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.446064:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789403267.446765:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403267.446793:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.446804:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403267.446888:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.446926:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403267.447028:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403267.449790:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723456 00000100:00100000:2.0:1789403267.449805:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723456 00000100:00100000:2.0:1789403267.449881:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789403267.449909:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050723456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403267.450151:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050723456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.450158:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789403267.450850:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.450906:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.451086:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.451129:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403267.451442:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723584 00000100:00100000:2.0:1789403267.451449:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723584 00000100:00100000:2.0:1789403267.451804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789403267.451814:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050723584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403267.451927:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050723584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.451934:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789403267.452052:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.452729:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13773:1876325050723712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403267.452777:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403267.452811:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403267.452868:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723712 00000100:00100000:2.0:1789403267.452875:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723712 00000100:00100000:2.0:1789403267.452903:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789403267.452910:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:13773:x1876325050723712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403267.453262:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:13773:x1876325050723712:12345-0@lo:502:llog_process_th.0 Request processed in 351us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.453269:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789403267.453685:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13773:1876325050723712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789403267.453716:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403267.453727:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403267.453730:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403267.453739:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a1424b5800 00000020:00000080:0.0:1789403267.453742:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403267.453807:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403267.453812:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403267.453813:0:13773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403267.453817:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403267.453819:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403267.453821:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789403267.453824:0:13773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a1424b5800 00000020:00000080:0.0:1789403267.453834:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789403267.453873:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13773:1876325050723840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403267.453909:0:13773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403267.453941:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403267.454485:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723840 00000100:00100000:2.0:1789403267.454493:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723840 00000100:00100000:2.0:1789403267.454536:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789403267.454545:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:13773:x1876325050723840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403267.454653:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:13773:x1876325050723840:12345-0@lo:502:llog_process_th.0 Request processed in 109us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.454660:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789403267.456292:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13773:1876325050723840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789403267.456339:0:13773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403267.456349:0:13773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403267.456351:0:13773:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789403267.456357:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789403267.456946:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789403267.456975:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403267.456987:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.456998:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403267.457079:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403267.457083:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a27b560000 from 7 10000000:01000000:1.0:1789403267.457086:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403267.457120:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.457129:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.457138:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403267.457158:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.457233:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.457272:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403267.457326:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050723968 00000100:00100000:2.0:1789403267.457339:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050723968 00000100:00100000:2.0:1789403267.457410:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789403267.457421:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:6497:x1876325050723968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403267.457434:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403267.457446:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c7e00/0x5fb08b1e5b760e5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760e58 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403267.457469:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c7e00/0x5fb08b1e5b760e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e58 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403267.457479:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c7e00/0x5fb08b1e5b760e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e58 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403267.457487:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7e00, rc 0) 00000100:00100000:2.0:1789403267.457524:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050723968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.457530:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789403267.457653:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050723968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403267.457668:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.457677:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403267.457732:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.457758:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.457810:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403267.466740:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724096 00000100:00100000:0.0:1789403267.466756:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724096 00000100:00100000:0.0:1789403267.466827:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789403267.466838:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050724096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.468132:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050724096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1291us (10368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.468145:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789403267.469285:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.469350:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.469442:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.469480:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403267.470424:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724224 00000100:00100000:0.0:1789403267.470435:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724224 00000100:00100000:0.0:1789403267.470493:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789403267.470503:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050724224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.470648:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050724224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.470656:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789403267.470876:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.472843:0:13775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13775:1876325050724352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.472925:0:13775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.472972:0:13775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403267.473085:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724352 00000100:00100000:0.0:1789403267.473093:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724352 00000100:00100000:0.0:1789403267.473178:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789403267.473188:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:13775:x1876325050724352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403267.473332:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:13775:x1876325050724352:12345-0@lo:502:llog_process_th.0 Request processed in 145us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.473340:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789403267.473437:0:13775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13775:1876325050724352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403267.473477:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403267.473487:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.473494:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789403267.473501:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a27b560000 00000020:00000080:3.0:1789403267.473504:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789403267.473565:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403267.473876:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.473879:0:13775:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789403267.473884:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403267.473887:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.473889:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789403267.473893:0:13775:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a27b560000 00000020:00000080:3.0:1789403267.473895:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789403267.474134:0:13775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13775:1876325050724480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.474184:0:13775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789403267.486601:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789403267.489304:0:13775:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403267.491889:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724480 00000100:00100000:1.0:1789403267.491904:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724480 00000100:00100000:1.0:1789403267.491986:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789403267.491997:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:13775:x1876325050724480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403267.492415:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:13775:x1876325050724480:12345-0@lo:502:llog_process_th.0 Request processed in 419us (18229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.492424:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789403267.492494:0:13775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13775:1876325050724480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403267.492530:0:13775:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403267.492546:0:13775:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403267.492549:0:13775:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789403267.492554:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789403267.493311:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789403267.493338:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403267.493348:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.493362:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403267.493372:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403267.493375:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b11800 from 7 10000000:01000000:1.0:1789403267.493379:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403267.493529:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.493538:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.493547:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403267.493568:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.493618:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.493811:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403267.493831:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724608 00000100:00100000:1.0:1789403267.493838:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724608 00000100:00100000:1.0:1789403267.493871:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789403267.493880:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:6497:x1876325050724608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403267.493890:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403267.493907:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144062600/0x5fb08b1e5b760e6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760e66 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.493931:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144062600/0x5fb08b1e5b760e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e66 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.493942:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144062600/0x5fb08b1e5b760e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e66 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.493950:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062600, rc 0) 00000100:00100000:1.0:1789403267.493987:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050724608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.493994:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789403267.494115:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403267.494129:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.494139:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403267.494208:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.494235:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.494251:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403267.494263:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724736 00000100:00100000:1.0:1789403267.494266:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724736 00000100:00100000:1.0:1789403267.494285:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789403267.494292:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050724736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.494426:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050724736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.494440:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789403267.494472:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.494506:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.494547:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.494562:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403267.494574:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724864 00000100:00100000:1.0:1789403267.494578:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724864 00000100:00100000:1.0:1789403267.494596:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789403267.494601:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050724864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.494967:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050724864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 364us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.494973:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789403267.495100:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050724864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789403267.497220:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789403267.497335:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13779:1876325050724992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.497555:0:13779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.497594:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403267.497822:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050724992 00000100:00100000:0.0:1789403267.497830:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050724992 00000100:00100000:0.0:1789403267.497880:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789403267.497889:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:13779:x1876325050724992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.498113:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13779:1876325050724992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403267.498150:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403267.498161:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.498164:0:13779:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789403267.498171:0:13779:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a281b11800 00000020:00000080:3.0:1789403267.498174:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789403267.498243:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403267.498497:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.498500:0:13779:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789403267.498504:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403267.498507:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.498509:0:13779:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789403267.498514:0:13779:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a281b11800 00000020:00000080:3.0:1789403267.498516:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789403267.498749:0:13779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13779:1876325050725120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.498793:0:13779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.498829:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725120 00000100:00100000:3.0:1789403267.498835:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725120 00000100:00100000:3.0:1789403267.498865:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789403267.498873:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:13779:x1876325050725120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.498953:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:13779:x1876325050725120:12345-0@lo:502:llog_process_th.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.498960:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789403267.499182:0:13779:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403267.499209:0:13779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13779:1876325050725120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403267.499227:0:13779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403267.499232:0:13779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.499233:0:13779:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789403267.499237:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:0.0:1789403267.499409:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:13779:x1876325050724992:12345-0@lo:502:llog_process_th.0 Request processed in 117us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.499420:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000020:01000000:1.0:1789403267.499517:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789403267.499540:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403267.499550:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.499563:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403267.499574:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403267.499577:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a244ea0000 from 7 10000000:01000000:1.0:1789403267.499580:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403267.499603:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.499612:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403267.499802:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403267.499819:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050725248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.499850:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.499866:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403267.500035:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725248 00000100:00100000:3.0:1789403267.500041:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725248 00000100:00100000:3.0:1789403267.500065:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789403267.500071:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:6497:x1876325050725248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403267.500080:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403267.500090:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b760e74 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.500111:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e74 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.500121:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b760e74 expref: 24 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.500129:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184a00, rc 0) 00000100:00100000:3.0:1789403267.500161:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050725248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.500186:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789403267.500229:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050725248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403267.500242:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.500250:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403267.500304:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050725376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.500331:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.500354:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403267.500365:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725376 00000100:00100000:3.0:1789403267.500369:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725376 00000100:00100000:3.0:1789403267.500416:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789403267.500422:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050725376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.500528:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050725376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.500535:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789403267.500564:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050725376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.500591:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050725504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.500635:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.500652:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403267.500663:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725504 00000100:00100000:3.0:1789403267.500667:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725504 00000100:00100000:3.0:1789403267.500683:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789403267.500695:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050725504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.500766:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:6497:x1876325050725504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.500773:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789403267.500806:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ffb2a5d6-5856-4505-b5af-5b30dcef2165:6497:1876325050725504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403267.500998:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13781:1876325050725632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.501031:0:13781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.501048:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725632 00000100:00100000:3.0:1789403267.501052:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725632 00000100:00100000:3.0:1789403267.501073:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789403267.501079:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:13781:x1876325050725632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.501143:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:13781:x1876325050725632:12345-0@lo:502:llog_process_th.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.501150:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789403267.501180:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403267.501215:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13781:1876325050725632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403267.501236:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403267.501243:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.501245:0:13781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789403267.501251:0:13781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a244ea0000 00000020:00000080:3.0:1789403267.501253:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789403267.501300:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403267.501602:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.501604:0:13781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789403267.501609:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403267.501612:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.501619:0:13781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789403267.501623:0:13781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a244ea0000 00000020:00000080:3.0:1789403267.501625:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789403267.501812:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13781:1876325050725760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.501849:0:13781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403267.501871:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725760 00000100:00100000:3.0:1789403267.501874:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725760 00000100:00100000:3.0:1789403267.501898:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789403267.501904:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:13781:x1876325050725760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403267.501968:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:13781:x1876325050725760:12345-0@lo:502:llog_process_th.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.501974:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789403267.502009:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403267.502021:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ffb2a5d6-5856-4505-b5af-5b30dcef2165:13781:1876325050725760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789403267.502038:0:13781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403267.502041:0:13781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403267.502042:0:13781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789403267.502046:0:13781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789403267.502094:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789403267.502113:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403267.502121:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.502131:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.570097:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403267.656980:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403267.657033:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403267.657072:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403267.657109:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403267.657138:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403267.657168:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057216 00000100:00100000:2.0:1789403267.657175:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403267.657188:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057216 00000100:00100000:2.0:1789403267.657222:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057728 00000100:00100000:2.0:1789403267.657233:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057728 00000100:00100000:3.0:1789403267.657308:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057344 00000100:00100000:2.0:1789403267.657310:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057600 00000100:00100000:3.0:1789403267.657316:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057344 00000100:00100000:2.0:1789403267.657331:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057600 00000100:00100000:3.0:1789403267.657359:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:3.0:1789403267.657373:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038057728:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403267.657493:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057472 00000100:00100000:0.0:1789403267.657499:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057472 00000100:00100000:0.0:1789403267.657546:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:0.0:1789403267.657559:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038057472:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403267.657639:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038057728:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 267us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.659255:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:2.0:1789403267.659277:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038057216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403267.661369:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038057472:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3806us (4326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.661384:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:0.0:1789403267.661915:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789403267.661925:0:6501:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789403267.662037:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:0.0:1789403267.662051:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038057344:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403267.662107:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038057344:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 61us (4969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.662114:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:0.0:1789403267.662131:0:6501:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789403267.662138:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:0.0:1789403267.662145:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038057600:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403267.662175:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038057600:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (5004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.662181:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:2.0:1789403267.664906:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038057216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 5626us (7922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.664921:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00080000:2.0:1789403267.664976:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403267.664982:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403267.664984:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403267.664995:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057088 00000100:00100000:2.0:1789403267.665005:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057088 00000100:00100000:2.0:1789403267.665059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 356 00000100:00100000:2.0:1789403267.665068:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:2388:x1876325038057088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403267.665115:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+11:2388:x1876325038057088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 48us (8006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403267.665121:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 356 00000100:00100000:3.0:1789403267.668076:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:2.0:1789403267.722906:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403267.723139:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057856 00000100:00100000:0.0:1789403267.723149:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057856 00000100:00100000:0.0:1789403267.723262:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 357 00000100:00100000:0.0:1789403267.723274:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+11:6162:x1876325038057856:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403267.723299:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403267.723317:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b760e82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128706 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.723350:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b760e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128706 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.723362:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b760e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128706 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403267.723372:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0000, rc 0) 00000100:00100000:0.0:1789403267.723472:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038057856:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 201us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.723498:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 357 00000100:00100000:2.0:1789403267.733645:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403267.734432:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038057984 00000100:00100000:0.0:1789403267.734445:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038057984 00000100:00100000:0.0:1789403267.734637:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 358 00000100:00100000:0.0:1789403267.734648:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038057984:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.734809:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038057984:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 162us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.734817:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 358 00000100:00100000:2.0:1789403267.737986:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403267.738201:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058112 00000100:00100000:0.0:1789403267.738212:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058112 00000100:00100000:0.0:1789403267.738271:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 359 00000100:00100000:0.0:1789403267.738291:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038058112:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.741300:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27003c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038058112:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 3008us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.741314:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 359 00000100:00100000:2.0:1789403267.747217:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403267.748485:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058240 00000100:00100000:3.0:1789403267.748499:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058240 00000100:00100000:3.0:1789403267.748934:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 360 00000100:00100000:3.0:1789403267.748946:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:10774:x1876325038058240:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789403267.749111:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:10774:x1876325038058240:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 167us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.749120:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 360 00000100:00100000:2.0:1789403267.762364:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403267.762691:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058368 00000100:00100000:0.0:1789403267.762707:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058368 00000100:00100000:0.0:1789403267.762775:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 361 00000100:00100000:0.0:1789403267.762786:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:10774:x1876325038058368:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403267.762954:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+12:10774:x1876325038058368:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 169us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.762963:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 361 00000100:00100000:2.0:1789403267.771446:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403267.771988:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058496 00000100:00100000:3.0:1789403267.772002:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058496 00000100:00100000:3.0:1789403267.772076:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 362 00000100:00100000:3.0:1789403267.772088:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+12:6162:x1876325038058496:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403267.772111:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403267.772134:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b760e89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12870d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.772174:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b760e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12870d expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.772187:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b760e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12870d expref: 13 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403267.772228:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184c00, rc 0) 00000100:00100000:3.0:1789403267.772306:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038058496:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 220us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403267.772314:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 362 00000100:00100000:2.0:1789403267.779683:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403267.779800:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058624 00000100:00100000:1.0:1789403267.779817:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058624 00000100:00100000:1.0:1789403267.780015:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 363 00000100:00100000:1.0:1789403267.780231:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038058624:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403267.780460:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038058624:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 434us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.780468:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 363 00000100:00100000:2.0:1789403267.785271:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403267.785381:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058752 00000100:00100000:0.0:1789403267.785686:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058752 00000100:00100000:0.0:1789403267.785775:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 364 00000100:00100000:0.0:1789403267.785787:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038058752:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403267.786164:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:6162:x1876325038058752:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 378us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.786173:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 364 00000100:00100000:2.0:1789403267.803563:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403267.805749:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038058880 00000100:00100000:1.0:1789403267.805770:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038058880 00000100:00100000:1.0:1789403267.805869:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 365 00000100:00100000:1.0:1789403267.805884:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:10778:x1876325038058880:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403267.806313:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:10778:x1876325038058880:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 431us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.806322:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 365 00000100:00100000:2.0:1789403267.812371:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403267.812854:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059008 00000100:00100000:0.0:1789403267.812868:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059008 00000100:00100000:0.0:1789403267.812945:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 366 00000100:00100000:0.0:1789403267.812959:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:10778:x1876325038059008:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403267.813150:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:10778:x1876325038059008:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 193us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403267.813158:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 366 00000100:00100000:0.0:1789403267.826625:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403267.826657:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050725888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403267.826754:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.827165:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050725888 00000100:00100000:1.0:1789403267.827175:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050725888 00000100:00100000:0.0:1789403267.827292:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050726016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403267.827328:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403267.835324:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726016 00000100:00100000:1.0:1789403267.835350:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726016 00000100:00100000:1.0:1789403267.835509:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789403267.835522:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050725888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403267.836022:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403267.836142:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050725888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 623us (9387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.836150:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789403267.836173:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789403267.836181:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050726016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403267.836207:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403267.836234:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050726016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (8905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403267.836241:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789403267.836312:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050726016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403267.836331:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050725888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789403267.836788:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403268.337789:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050726144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403268.337914:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403268.338048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726144 00000100:00100000:3.0:1789403268.338058:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726144 00000100:00100000:3.0:1789403268.338120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789403268.338128:0:6504:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789403268.338133:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050726144:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403268.338140:0:6504:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:3.0:1789403268.338178:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403268.338250:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050726144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403268.338259:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789403268.338325:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050726144:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789403268.530214:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789403268.530988:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789403268.593855:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403269.364511:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403269.364542:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050726272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403269.364640:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.364977:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726272 00000100:00100000:3.0:1789403269.364988:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726272 00000100:00100000:3.0:1789403269.365063:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789403269.365075:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050726272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403269.365122:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789403269.365214:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050726272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403269.365221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789403269.365328:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050726272:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403269.618344:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403269.873914:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403269.873946:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050726400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403269.874041:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.874297:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403269.874319:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050726656:0@lo:400:kworker.0 00000100:00100000:3.0:1789403269.874359:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.874453:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050726784:0@lo:400:kworker.0 00000100:00100000:3.0:1789403269.874481:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.874543:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403269.874550:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050727168:0@lo:400:kworker.0 00000100:00100000:3.0:1789403269.874576:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.874617:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050727296:0@lo:400:kworker.0 00000100:00100000:3.0:1789403269.874646:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.874698:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403269.874705:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050727680:0@lo:400:kworker.0 00000100:00100000:3.0:1789403269.874731:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403269.874774:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050727808:0@lo:400:kworker.0 00000100:00100000:3.0:1789403269.874797:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403269.875128:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726656 00000100:00100000:0.0:1789403269.875138:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726656 00000100:00100000:0.0:1789403269.875210:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726784 00000100:00100000:0.0:1789403269.875222:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726784 00000100:00100000:0.0:1789403269.875238:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727168 00000100:00100000:0.0:1789403269.875240:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727168 00000100:00100000:0.0:1789403269.875265:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727680 00000100:00100000:0.0:1789403269.875268:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727680 00000100:00100000:0.0:1789403269.875287:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789403269.875296:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050726656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.875377:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050726656:12345-0@lo:400:kworker.0 Request processed in 82us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.875385:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789403269.875426:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789403269.875432:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050726784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.875461:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050726784:12345-0@lo:400:kworker.0 Request processed in 29us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.875467:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789403269.875479:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789403269.875485:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050727168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.875512:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050727168:12345-0@lo:400:kworker.0 Request processed in 28us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.875518:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789403269.875529:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789403269.875535:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050727680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.875564:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050727680:12345-0@lo:400:kworker.0 Request processed in 30us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.875569:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789403269.875591:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727296 00000100:00100000:0.0:1789403269.875595:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727296 00000100:00100000:0.0:1789403269.875631:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727808 00000100:00100000:0.0:1789403269.875635:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727808 00000100:00100000:0.0:1789403269.875652:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789403269.875659:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050727296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.875693:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050727296:12345-0@lo:400:kworker.0 Request processed in 35us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.875699:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789403269.875710:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789403269.875715:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050727808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.875742:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050727808:12345-0@lo:400:kworker.0 Request processed in 28us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.875748:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789403269.875764:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403269.875768:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403269.875771:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789403269.875823:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f7480 x1876325050727808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403269.876099:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050726912:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403269.876169:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050727424:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876205:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403269.876228:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789403269.876235:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050726528:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876265:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403269.876291:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050727040:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876325:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403269.876344:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050727552:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876364:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403269.876406:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727040 00000100:00100000:2.0:1789403269.876411:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727040 00000100:00100000:2.0:1789403269.876444:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727552 00000100:00100000:2.0:1789403269.876447:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727552 00000100:00100000:2.0:1789403269.876464:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789403269.876471:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050727040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876508:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050727040:12345-0@lo:400:kworker.0 Request processed in 38us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403269.876514:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789403269.876527:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789403269.876533:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050727552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876569:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050727552:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403269.876575:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789403269.876592:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727424 00000100:00100000:2.0:1789403269.876595:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727424 00000100:00100000:2.0:1789403269.876617:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789403269.876622:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050727424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876646:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050727424:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403269.876651:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789403269.876669:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403269.876672:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403269.876695:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050727040:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876704:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050727552:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876712:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050727424:0@lo:400:kworker.0 00000100:00100000:2.0:1789403269.876749:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726912 00000100:00100000:2.0:1789403269.876752:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726912 00000100:00100000:2.0:1789403269.876777:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403269.876782:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050726912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.878013:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050727808:0@lo:400:kworker.0 00010000:00080000:0.0:1789403269.878054:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143530000 x1876325050727680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403269.878065:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050727680:0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.878079:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050727296:0@lo:400:kworker.0 00010000:00080000:0.0:1789403269.878092:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143533800 x1876325050727168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403269.878100:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050727168:0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.878136:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050726784:0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.878147:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050726656:0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.878274:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726400 00000100:00100000:0.0:1789403269.878281:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726400 00000100:00100000:0.0:1789403269.878343:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789403269.878351:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050726400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403269.878384:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403269.878469:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050726400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.878476:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789403269.878499:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403269.878542:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050727936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403269.878582:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403269.878619:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050726912:0@lo:400:kworker.0 00000100:00100000:0.0:1789403269.878642:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050727936 00000100:00100000:0.0:1789403269.878645:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050727936 00000100:00100000:0.0:1789403269.878666:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789403269.878672:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050727936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403269.878686:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403269.878715:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050727936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403269.878721:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789403269.878744:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f100 x1876325050727936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403269.878758:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050727936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403269.879105:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050726912:12345-0@lo:400:kworker.0 Request processed in 50us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403269.879116:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1789403269.879244:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143380a80 x1876325050726400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403269.879261:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050726400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403269.879291:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050726528 00000100:00100000:1.0:1789403269.879295:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050726528 00000100:00100000:1.0:1789403269.879343:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789403269.879350:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050726528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403269.879427:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050726528:12345-0@lo:400:kworker.0 Request processed in 77us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403269.879445:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789403269.879581:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050726528:0@lo:400:kworker.0 00010000:00010000:1.0:1789403270.641714:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403271.665855:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789403271.923524:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1789403272.689907:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403272.776489:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403272.776540:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403272.776658:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403272.776706:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403272.776732:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403272.776769:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403272.776806:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059776 00000100:00100000:1.0:1789403272.776806:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059264 00000100:00100000:2.0:1789403272.776820:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059776 00000100:00100000:1.0:1789403272.776820:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059264 00000100:00100000:1.0:1789403272.776898:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059392 00000100:00100000:1.0:1789403272.776902:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059392 00000100:00100000:1.0:1789403272.776919:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059648 00000100:00100000:1.0:1789403272.776922:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059648 00000100:00100000:1.0:1789403272.776940:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:1.0:1789403272.776950:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038059264:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403272.777055:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038059264:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 106us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403272.777064:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:1.0:1789403272.777092:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:1.0:1789403272.777098:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038059392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403272.777123:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038059392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403272.777128:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:3.0:1789403272.777184:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038059648:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403272.777223:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038059648:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 85us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403272.778853:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059520 00000100:00100000:0.0:1789403272.778880:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059520 00000100:00100000:0.0:1789403272.778957:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:0.0:1789403272.778968:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038059520:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403272.779042:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038059520:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 76us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403272.779050:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00080000:0.0:1789403272.779084:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403272.779089:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403272.779092:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403272.779260:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:1.0:1789403272.779343:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059136 00000100:00100000:1.0:1789403272.779348:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059136 00000100:00100000:1.0:1789403272.779383:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 368 00000100:00100000:1.0:1789403272.779412:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038059136:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403272.779451:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038059136:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 60us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403272.779458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 368 00000100:00100000:2.0:1789403272.781244:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:2.0:1789403272.781265:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038059776:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403272.781374:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038059776:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 117us (4715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403272.781382:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:3.0:1789403272.782329:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:1.0:1789403272.945684:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403272.945792:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403272.945860:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728064 00000100:00100000:3.0:1789403272.945872:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728064 00000100:00100000:3.0:1789403272.945947:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789403272.945959:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050728064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403272.945997:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403272.946052:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050728064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403272.946059:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789403272.946111:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403272.947573:0:3629:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789403272.947589:0:3629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a27a740700, transno 4294967301 00000100:00100000:1.0:1789403272.947625:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403272.951695:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050728192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403272.952170:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403272.952547:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728192 00000100:00100000:0.0:1789403272.952560:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728192 00000100:00100000:0.0:1789403272.952686:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789403272.952699:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050728192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403272.952731:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403272.952800:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050728192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403272.952820:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789403272.952894:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050728192:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789403272.953797:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403273.458121:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403273.458162:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050728320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403273.458267:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403273.458537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728320 00000100:00100000:2.0:1789403273.458549:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728320 00000100:00100000:2.0:1789403273.458620:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789403273.458632:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050728320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403273.458678:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403273.458960:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050728320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 331us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403273.458969:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789403273.462625:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050728320:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789403273.714253:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403274.482057:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050728448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403274.482169:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403274.482349:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728448 00000100:00100000:0.0:1789403274.482360:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728448 00000100:00100000:0.0:1789403274.482454:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789403274.482465:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050728448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403274.482510:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403274.483656:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050728448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1186us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403274.483668:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789403274.483676:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050728448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403274.740858:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403274.993659:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403274.993696:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050728704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403274.993790:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.993845:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050728960:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.993859:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050728832:0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.993885:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403274.993886:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.993910:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050729472:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.993910:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050729344:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.993930:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403274.993945:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050729856:0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.993947:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.993963:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050729984:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.993965:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.993981:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403274.993981:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789403274.993986:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050729216:0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.993995:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789403274.994000:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050728576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403274.994007:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.994021:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403274.994023:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050729728:0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.994035:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050729088:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.994044:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.994053:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.994063:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050729600:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.994063:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050730240:0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.994079:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403274.994091:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728960 00000100:00100000:2.0:1789403274.994100:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728960 00000100:00100000:0.0:1789403274.994109:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728832 00000100:00100000:0.0:1789403274.994112:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728832 00000100:00100000:2.0:1789403274.994155:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729344 00000100:00100000:2.0:1789403274.994159:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729344 00000100:00100000:0.0:1789403274.994160:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789403274.994169:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050728832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.994182:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729472 00000100:00100000:2.0:1789403274.994185:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729472 00000100:00100000:2.0:1789403274.994196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729856 00000100:00100000:2.0:1789403274.994198:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729856 00000100:00100000:2.0:1789403274.994208:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729984 00000100:00100000:2.0:1789403274.994210:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729984 00000100:00100000:2.0:1789403274.994221:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729088 00000100:00100000:2.0:1789403274.994223:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729088 00000100:00100000:2.0:1789403274.994235:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789403274.994236:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050728832:12345-0@lo:400:kworker.0 Request processed in 68us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403274.994241:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050728960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.994243:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789403274.994273:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050728960:12345-0@lo:400:kworker.0 Request processed in 32us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403274.994279:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789403274.994346:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728704 00000100:00100000:1.0:1789403274.994351:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728704 00000100:00100000:1.0:1789403274.994382:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050728576 00000100:00100000:1.0:1789403274.994385:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050728576 00000100:00100000:1.0:1789403274.994436:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789403274.994442:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050728704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403274.994468:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403274.994507:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050728704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403274.994513:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789403274.994525:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789403274.994530:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050728576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403274.994539:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403274.994559:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050728576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403274.994565:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789403274.994911:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050729344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403274.994954:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050729344:12345-0@lo:400:kworker.0 Request processed in 668us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403274.999257:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789403274.999328:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789403274.999351:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050729472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.999509:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050729472:12345-0@lo:400:kworker.0 Request processed in 170us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403274.999516:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789403274.999530:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789403274.999538:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050729856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.999574:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050729856:12345-0@lo:400:kworker.0 Request processed in 38us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403274.999580:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789403274.999593:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789403274.999599:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050729984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.999631:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050729984:12345-0@lo:400:kworker.0 Request processed in 32us (5649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403274.999636:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789403274.999648:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789403274.999655:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050729088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403274.999685:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050729088:12345-0@lo:400:kworker.0 Request processed in 31us (5630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403274.999691:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789403274.999725:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729728 00000100:00100000:2.0:1789403274.999734:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729728 00000100:00100000:1.0:1789403274.999851:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729216 00000100:00100000:1.0:1789403274.999865:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729216 00000100:00100000:1.0:1789403274.999904:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789403274.999911:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050729216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403274.999956:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050729216:12345-0@lo:400:kworker.0 Request processed in 46us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403274.999963:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789403275.000028:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730240 00000100:00100000:2.0:1789403275.000034:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730240 00000100:00080000:3.0:1789403275.000243:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403275.000250:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403275.000254:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403275.000258:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403275.000265:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789403275.000276:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050729728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403275.000282:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403275.000330:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050730112:0@lo:400:kworker.0 00000100:00100000:3.0:1789403275.000375:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403275.000432:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050728960:0@lo:400:kworker.0 00010000:00080000:3.0:1789403275.000451:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143019880 x1876325050729472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403275.000461:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050729472:0@lo:400:kworker.0 00010000:00080000:3.0:1789403275.000475:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143019c00 x1876325050729984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403275.000484:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050729984:0@lo:400:kworker.0 00010000:00080000:3.0:1789403275.000523:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f6680 x1876325050728576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403275.000538:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050729728:12345-0@lo:400:kworker.0 Request processed in 264us (6490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403275.000543:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050728576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403275.000552:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789403275.000569:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050729600 00000100:00100000:1.0:1789403275.000573:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050729600 00000100:00100000:1.0:1789403275.000594:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730112 00000100:00100000:1.0:1789403275.000597:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730112 00000100:00100000:1.0:1789403275.000609:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789403275.000615:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050730240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000644:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050730240:12345-0@lo:400:kworker.0 Request processed in 30us (6564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403275.000650:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789403275.000660:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789403275.000665:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050729600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000688:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050729600:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403275.000693:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789403275.000701:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789403275.000706:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050730112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000739:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050730112:12345-0@lo:400:kworker.0 Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403275.000745:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789403275.000786:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050729216:0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000797:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050729728:0@lo:400:kworker.0 00010000:00080000:1.0:1789403275.000807:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143018000 x1876325050730240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403275.000817:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050730240:0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000828:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050728832:0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000839:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050729344:0@lo:400:kworker.0 00000100:00100000:1.0:1789403275.000849:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050729856:0@lo:400:kworker.0 00010000:00080000:1.0:1789403275.000861:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f480 x1876325050728704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403275.000873:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050728704:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789403275.000919:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403275.001317:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789403275.002220:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050729088:0@lo:400:kworker.0 00000100:00100000:3.0:1789403275.002257:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050729600:0@lo:400:kworker.0 00010000:00080000:3.0:1789403275.002274:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14301a300 x1876325050730112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403275.002285:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050730112:0@lo:400:kworker.0 00010000:00010000:0.0:1789403275.762237:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403276.785617:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403277.809528:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403277.896489:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403277.896537:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403277.896571:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403277.896602:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403277.896628:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403277.896682:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403277.896715:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060288 00000100:00100000:0.0:1789403277.896725:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060288 00000100:00100000:0.0:1789403277.896782:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:0.0:1789403277.896793:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038060288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403277.896861:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038060288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403277.896869:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:0.0:1789403277.896892:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060160 00000100:00100000:0.0:1789403277.896896:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060160 00000100:00100000:0.0:1789403277.896921:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060416 00000100:00100000:0.0:1789403277.896941:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060416 00000100:00100000:0.0:1789403277.896959:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060032 00000100:00100000:0.0:1789403277.896961:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060032 00000100:00100000:0.0:1789403277.896973:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060544 00000100:00100000:0.0:1789403277.896975:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060544 00000100:00100000:0.0:1789403277.896989:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:0.0:1789403277.896996:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038060160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403277.897028:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038060160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403277.897034:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:0.0:1789403277.897047:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:0.0:1789403277.897054:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038060416:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403277.897078:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038060416:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403277.897084:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:0.0:1789403277.897096:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:0.0:1789403277.897102:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038060032:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403277.897144:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038060032:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403277.897150:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:0.0:1789403277.897162:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:0.0:1789403277.897169:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038060544:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403277.897193:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038060544:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403277.897200:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:1.0:1789403277.897435:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038059904 00000100:00100000:1.0:1789403277.897440:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038059904 00000100:00100000:1.0:1789403277.897467:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 370 00000100:00100000:1.0:1789403277.897473:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038059904:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403277.897500:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038059904:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403277.897506:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 370 00000100:00080000:1.0:1789403277.897545:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403277.897549:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403277.897552:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403278.065698:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403278.065722:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050730496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403278.065722:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050730368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403278.066268:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403278.066312:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403278.066410:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730368 00000100:00100000:1.0:1789403278.066418:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730368 00000100:00100000:1.0:1789403278.066470:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730496 00000100:00100000:1.0:1789403278.066474:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730496 00000100:00100000:1.0:1789403278.066493:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789403278.066502:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050730368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403278.066531:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403278.066575:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050730368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403278.066582:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789403278.066597:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789403278.066603:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050730496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403278.066615:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403278.066639:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050730496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403278.066644:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1789403278.066662:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403278.066794:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050730368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403278.066795:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050730496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403278.578330:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050730624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403278.578428:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403278.578554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730624 00000100:00100000:3.0:1789403278.578563:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730624 00000100:00100000:3.0:1789403278.578627:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789403278.578636:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050730624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403278.578669:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403278.586173:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050730624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7528us (7734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403278.586186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789403278.590714:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050730624:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789403278.771318:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789403278.772914:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403278.836304:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403279.604770:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403279.604795:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050730752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403279.604921:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403279.605091:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730752 00000100:00100000:2.0:1789403279.605110:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730752 00000100:00100000:2.0:1789403279.605167:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789403279.605185:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050730752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403279.605219:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403279.605271:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050730752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403279.605278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789403279.605666:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050730752:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403279.857626:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403280.113653:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403280.113677:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050730880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403280.113747:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403280.114034:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050731008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403280.114066:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403280.114179:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050730880 00000100:00100000:0.0:1789403280.114188:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050730880 00000100:00100000:0.0:1789403280.114278:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731008 00000100:00100000:0.0:1789403280.114281:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731008 00000100:00080000:1.0:1789403280.114321:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403280.114891:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050731392:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.114929:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.114949:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050731904:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.114972:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.114990:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050732416:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115008:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115029:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789403280.115035:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050731264:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115054:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115071:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050731776:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115090:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115119:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050732288:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115140:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115163:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731904 00000100:00100000:1.0:1789403280.115167:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731904 00000100:00100000:1.0:1789403280.115195:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732416 00000100:00100000:1.0:1789403280.115198:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732416 00000100:00100000:1.0:1789403280.115211:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731264 00000100:00100000:1.0:1789403280.115214:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731264 00000100:00100000:1.0:1789403280.115225:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731776 00000100:00100000:1.0:1789403280.115227:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731776 00000100:00100000:1.0:1789403280.115238:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732288 00000100:00100000:1.0:1789403280.115240:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732288 00000100:00100000:1.0:1789403280.115254:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789403280.115262:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050731904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115310:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050731904:12345-0@lo:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115335:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789403280.115351:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789403280.115357:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050732416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115386:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050732416:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115425:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789403280.115438:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789403280.115444:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050731264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115471:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050731264:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115477:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789403280.115488:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789403280.115493:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050731776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115519:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050731776:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115524:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789403280.115535:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789403280.115540:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050732288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115565:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050732288:12345-0@lo:400:kworker.0 Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115570:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1789403280.115592:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403280.115595:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403280.115607:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050731136:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115643:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115667:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050731648:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115689:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115706:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050732160:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115729:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115748:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789403280.115752:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050731520:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115772:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115785:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050732032:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115802:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403280.115826:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731136 00000100:00100000:1.0:1789403280.115830:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731136 00000100:00100000:1.0:1789403280.115851:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789403280.115856:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050731136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115885:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050731136:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115890:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789403280.115911:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732160 00000100:00100000:1.0:1789403280.115915:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732160 00000100:00100000:1.0:1789403280.115938:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732032 00000100:00100000:1.0:1789403280.115940:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732032 00000100:00100000:1.0:1789403280.115953:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789403280.115958:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050732160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.115982:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050732160:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.115987:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789403280.116005:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789403280.116009:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050732032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116032:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050732032:12345-0@lo:400:kworker.0 Request processed in 22us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.116036:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1789403280.116053:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403280.116063:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731392 00000100:00100000:1.0:1789403280.116066:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731392 00000100:00100000:1.0:1789403280.116083:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731648 00000100:00100000:1.0:1789403280.116085:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731648 00000100:00100000:1.0:1789403280.116094:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789403280.116114:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050731392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116142:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050731392:12345-0@lo:400:kworker.0 Request processed in 30us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.116148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789403280.116158:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789403280.116164:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050731648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116188:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050731648:12345-0@lo:400:kworker.0 Request processed in 25us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.116193:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789403280.116211:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050731520 00000100:00100000:1.0:1789403280.116215:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050731520 00000100:00100000:1.0:1789403280.116233:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789403280.116238:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050731520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116265:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050731520:12345-0@lo:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403280.116271:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789403280.116316:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050731264:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116328:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050731776:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116337:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050732288:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116347:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050731392:0@lo:400:kworker.0 00010000:00080000:1.0:1789403280.116358:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a28183a680 x1876325050731904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403280.116367:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050731904:0@lo:400:kworker.0 00010000:00080000:1.0:1789403280.116376:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143596d80 x1876325050732416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403280.116385:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050732416:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116444:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050731520:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116452:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050732032:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116459:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050731136:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116467:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050731648:0@lo:400:kworker.0 00000100:00100000:1.0:1789403280.116475:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050732160:0@lo:400:kworker.0 00000100:00100000:3.0:1789403280.117948:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789403280.117964:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050730880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403280.117992:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403280.118254:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789403280.118264:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050731008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403280.118275:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403280.118511:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050730880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 552us (4764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403280.118519:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789403280.118728:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050731008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 467us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403280.118734:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1789403280.120969:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3f800 x1876325050731008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403280.120996:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050731008:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789403280.121033:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1434f4700 x1876325050730880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403280.121043:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050730880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789403280.882035:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403281.910343:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403282.929707:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403283.017601:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403283.017654:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403283.017689:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403283.017720:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060800 00000100:00100000:3.0:1789403283.017744:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060800 00000100:00100000:3.0:1789403283.017797:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060928 00000100:00100000:3.0:1789403283.017800:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060928 00000100:00100000:3.0:1789403283.017819:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:3.0:1789403283.017828:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038060800:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403283.017898:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038060800:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403283.017905:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:3.0:1789403283.017922:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 243 00000100:00100000:3.0:1789403283.017929:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038060928:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403283.018441:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038060928:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 509us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403283.018448:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 243 00000100:00100000:0.0:1789403283.018568:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038060672 00000100:00100000:0.0:1789403283.018574:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038060672 00000100:00100000:0.0:1789403283.018616:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 372 00000100:00100000:0.0:1789403283.018624:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038060672:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403283.018653:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038060672:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403283.018659:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 372 00000100:00080000:1.0:1789403283.018890:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403283.018894:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403283.033257:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403283.033307:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403283.033340:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403283.033478:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061184 00000100:00100000:3.0:1789403283.033488:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061184 00000100:00100000:3.0:1789403283.033551:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061312 00000100:00100000:3.0:1789403283.033554:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061312 00000100:00100000:3.0:1789403283.033590:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:3.0:1789403283.033599:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061184:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403283.033670:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061184:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 72us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403283.033678:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:3.0:1789403283.033694:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 245 00000100:00100000:3.0:1789403283.033700:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061312:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403283.033725:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061312:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403283.033739:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 245 00000100:00080000:1.0:1789403283.034665:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403283.034673:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403283.034739:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061056 00000100:00100000:2.0:1789403283.034746:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061056 00000100:00100000:2.0:1789403283.034819:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1789403283.034828:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2386:x1876325038061056:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:2.0:1789403283.034850:0:8415:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760db0 00000100:00080000:2.0:1789403283.034859:0:8415:0:(import.c:65:import_set_state_nolock()) ffff90a1436b6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789403283.034911:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1789403283.035055:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+2:2386:x1876325038061056:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 228us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403283.035062:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00080000:1.0:1789403283.035278:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789403283.035368:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403283.185881:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403283.185908:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050732544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403283.185983:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403283.186556:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732544 00000100:00100000:2.0:1789403283.186566:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732544 00000100:00080000:1.0:1789403283.186640:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403283.186972:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050732672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403283.187015:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403283.193945:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732672 00000100:00100000:2.0:1789403283.193960:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732672 00000100:00100000:2.0:1789403283.194015:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789403283.194024:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050732544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403283.194054:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403283.194136:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050732544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (8152us total) trans 0 rc 0/0 00000100:00080000:0.0:1789403283.194293:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403283.194321:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789403283.194331:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789403283.194344:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050732672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403283.194414:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050732544:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403283.194461:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403283.194513:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050732672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403283.194520:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789403283.197559:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050732672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403283.697949:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050732800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403283.698029:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403283.698658:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732800 00000100:00100000:2.0:1789403283.698667:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732800 00000100:00100000:2.0:1789403283.698721:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789403283.698731:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050732800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403283.698763:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403283.698823:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050732800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403283.698830:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789403283.698968:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050732800:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403283.954019:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403284.723832:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050732928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403284.723903:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403284.726032:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050732928 00000100:00100000:0.0:1789403284.726046:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050732928 00000100:00100000:0.0:1789403284.726120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789403284.726131:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050732928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403284.726166:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789403284.730838:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050732928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4698us (6923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403284.730854:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789403284.730866:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050732928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403284.977576:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403285.233898:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403285.234005:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403285.234025:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050733184:0@lo:400:kworker.0 00000100:00100000:0.0:1789403285.234099:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.234161:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050733312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403285.234200:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733184 00000100:00100000:3.0:1789403285.234203:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403285.234209:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733184 00000100:00100000:3.0:1789403285.234236:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403285.234244:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050733440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403285.234259:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789403285.234270:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403285.234285:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050733184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.234306:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733312 00000100:00100000:3.0:1789403285.234312:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733312 00000100:00100000:3.0:1789403285.234352:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733440 00000100:00100000:3.0:1789403285.234356:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733440 00000100:00100000:0.0:1789403285.234357:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050733184:12345-0@lo:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403285.234366:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789403285.234376:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789403285.234384:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050733312:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789403285.234424:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789403285.234426:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403285.234455:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050733184:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.234469:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050733312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.234476:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789403285.234493:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789403285.234500:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050733440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403285.234510:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403285.234537:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050733440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.234543:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789403285.234570:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aafb80 x1876325050733440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403285.234592:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050733440:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789403285.234604:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14301b800 x1876325050733312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403285.234614:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050733312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403285.236474:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050733056:0@lo:400:kworker.0 00000100:00100000:2.0:1789403285.236557:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403285.236945:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733056 00000100:00100000:0.0:1789403285.236954:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733056 00000100:00100000:0.0:1789403285.237181:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789403285.237193:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050733056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403285.237275:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050733056:12345-0@lo:400:kworker.0 Request processed in 85us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403285.237283:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789403285.237379:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050733056:0@lo:400:kworker.0 00000100:00100000:0.0:1789403285.240749:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050733568:0@lo:400:kworker.0 00000100:00100000:0.0:1789403285.240824:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.240860:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050733696:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.240903:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.241004:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403285.241011:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050734080:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241038:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403285.241073:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050733824:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241087:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733696 00000100:00100000:3.0:1789403285.241096:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733696 00000100:00100000:0.0:1789403285.241106:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.241136:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734080 00000100:00100000:3.0:1789403285.241139:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734080 00000100:00100000:3.0:1789403285.241164:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789403285.241171:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050733696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241227:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050733696:12345-0@lo:400:kworker.0 Request processed in 57us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.241234:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789403285.241248:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789403285.241254:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050734080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241408:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050734080:12345-0@lo:400:kworker.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.241415:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00010000:00080000:3.0:1789403285.241466:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f480 x1876325050734080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403285.241479:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050734080:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241489:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050733696:0@lo:400:kworker.0 00000100:00080000:3.0:1789403285.241523:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403285.241541:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050733952:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241565:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.241598:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733952 00000100:00100000:3.0:1789403285.241602:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733952 00000100:00100000:3.0:1789403285.241628:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789403285.241634:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050733952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.241663:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050733952:12345-0@lo:400:kworker.0 Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.241669:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1789403285.241681:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403285.241712:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050733952:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242185:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050734208:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242415:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.242542:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403285.242549:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050734592:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242573:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.242601:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734592 00000100:00100000:3.0:1789403285.242606:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734592 00000100:00100000:3.0:1789403285.242644:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789403285.242651:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050734592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242763:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050734592:12345-0@lo:400:kworker.0 Request processed in 112us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.242770:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:3.0:1789403285.242788:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789403285.242812:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251fb80 x1876325050734592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403285.242824:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050734592:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242857:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734208 00000100:00100000:3.0:1789403285.242861:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734208 00000100:00100000:3.0:1789403285.242888:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789403285.242894:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050734208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242926:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050734208:12345-0@lo:400:kworker.0 Request processed in 32us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.242932:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789403285.242944:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403285.242967:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050734208:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.242989:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050734464:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.243010:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.243028:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403285.243034:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050734336:0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.243053:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403285.243088:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734464 00000100:00100000:3.0:1789403285.243092:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734464 00000100:00100000:3.0:1789403285.243119:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789403285.243125:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050734464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403285.243183:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050734464:12345-0@lo:400:kworker.0 Request processed in 58us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403285.243189:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1789403285.243203:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403285.243453:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734336 00000100:00100000:1.0:1789403285.243458:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734336 00000100:00100000:3.0:1789403285.243513:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050734464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403285.243640:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789403285.243646:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050734336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403285.243685:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050734336:12345-0@lo:400:kworker.0 Request processed in 39us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403285.243691:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789403285.243729:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050734336:0@lo:400:kworker.0 00000100:00080000:3.0:1789403285.243853:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403285.246906:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733568 00000100:00100000:1.0:1789403285.246906:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050733824 00000100:00100000:2.0:1789403285.246921:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733568 00000100:00100000:1.0:1789403285.246921:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050733824 00000100:00100000:1.0:1789403285.247005:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789403285.247013:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789403285.247018:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050733824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403285.247027:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050733568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403285.247159:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050733568:12345-0@lo:400:kworker.0 Request processed in 137us (6335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403285.247166:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789403285.247200:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050733824:12345-0@lo:400:kworker.0 Request processed in 185us (6092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403285.247208:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789403285.247299:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050733568:0@lo:400:kworker.0 00000100:00100000:0.0:1789403285.247627:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050733824:0@lo:400:kworker.0 00010000:00010000:1.0:1789403286.001711:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403287.027069:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403288.054472:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403288.137715:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403288.137765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403288.137804:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403288.137874:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061696 00000100:00100000:0.0:1789403288.137884:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061696 00000100:00100000:0.0:1789403288.137961:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061952 00000100:00100000:0.0:1789403288.137966:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061952 00000100:00100000:0.0:1789403288.137989:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:0.0:1789403288.138000:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038061696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403288.138102:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038061696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403288.138110:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:0.0:1789403288.138129:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:0.0:1789403288.138136:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403288.138161:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403288.138173:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00080000:1.0:1789403288.138313:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403288.138375:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061440 00000100:00100000:3.0:1789403288.138381:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061440 00000100:00100000:3.0:1789403288.138441:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 374 00000100:00100000:3.0:1789403288.138449:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038061440:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403288.138478:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038061440:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403288.138484:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 374 00000100:00100000:3.0:1789403288.138793:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403288.138900:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403288.139189:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061568 00000100:00100000:1.0:1789403288.139196:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061568 00000100:00100000:1.0:1789403288.139239:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038061824 00000100:00100000:1.0:1789403288.139243:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038061824 00000100:00100000:1.0:1789403288.139264:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:1.0:1789403288.139272:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038061568:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403288.139314:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038061568:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 35us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403288.139321:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:1.0:1789403288.139340:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00100000:1.0:1789403288.139347:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061824:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403288.139373:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038061824:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403288.139384:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00080000:0.0:1789403288.139459:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403288.308176:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403288.308198:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050734720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403288.308265:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403288.308326:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734720 00000100:00100000:0.0:1789403288.308334:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734720 00000100:00100000:0.0:1789403288.308385:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789403288.308409:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050734720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403288.308436:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403288.308480:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050734720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403288.308486:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789403288.308507:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403288.308541:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050734720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403288.312639:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050734848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403288.312852:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403288.315063:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734848 00000100:00100000:2.0:1789403288.315075:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734848 00000100:00080000:0.0:1789403288.315194:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403288.315196:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789403288.315205:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050734848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403288.315230:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403288.315303:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050734848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403288.315321:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789403288.315416:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14301a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050734848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403288.822715:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050734976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403288.822785:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403288.822946:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050734976 00000100:00100000:2.0:1789403288.822955:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050734976 00000100:00100000:2.0:1789403288.823005:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789403288.823015:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14301a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050734976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403288.823308:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789403288.823375:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14301a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050734976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 361us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403288.823382:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789403288.823633:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050734976:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1789403288.826487:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:2.0:1789403288.826496:0:8409:0:(genops.c:885:class_export_put()) final put ffff90a277bde000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:0.0:1789403288.827081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a277bde000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-OST0000 00000020:00000080:0.0:1789403288.827147:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1436b6000 for lustre-OST0000 00000040:00080000:0.0:1789403289.011118:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789403289.018937:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403289.074499:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403289.848447:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050735104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403289.848559:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403289.848603:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735104 00000100:00100000:2.0:1789403289.848616:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735104 00000100:00100000:2.0:1789403289.848682:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789403289.848694:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050735104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403289.848739:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403289.848800:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050735104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403289.855657:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789403289.855814:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050735104:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403290.101777:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403290.353926:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050735232:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354044:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354104:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050735744:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354135:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354158:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050736256:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354184:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354201:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050736768:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354221:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354253:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789403290.354259:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050735616:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354302:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050736128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354323:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354339:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050736640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354359:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354419:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050735360:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354466:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354489:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050735872:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354512:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354526:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050736384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354546:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354561:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789403290.354567:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050735488:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354603:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354622:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050736000:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354643:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354659:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050736512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354681:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403290.354708:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735232 00000100:00100000:1.0:1789403290.354717:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735232 00000100:00100000:1.0:1789403290.354772:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789403290.354781:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050735232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354840:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2513dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050735232:12345-0@lo:400:kworker.0 Request processed in 60us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.354847:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789403290.354884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735744 00000100:00100000:1.0:1789403290.354887:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735744 00000100:00100000:1.0:1789403290.354913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735488 00000100:00100000:1.0:1789403290.354915:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735488 00000100:00100000:1.0:1789403290.354928:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789403290.354934:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050735744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.354968:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050735744:12345-0@lo:400:kworker.0 Request processed in 35us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.354974:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789403290.354986:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789403290.354992:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050735488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355037:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050735488:12345-0@lo:400:kworker.0 Request processed in 45us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355042:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789403290.355068:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736256 00000100:00100000:1.0:1789403290.355072:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736256 00000100:00100000:1.0:1789403290.355104:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736768 00000100:00100000:1.0:1789403290.355106:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736768 00000100:00100000:1.0:1789403290.355119:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736128 00000100:00100000:1.0:1789403290.355121:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736128 00000100:00100000:1.0:1789403290.355134:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736640 00000100:00100000:1.0:1789403290.355136:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736640 00000100:00100000:1.0:1789403290.355150:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789403290.355156:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050736256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355189:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050736256:12345-0@lo:400:kworker.0 Request processed in 33us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355197:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789403290.355209:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789403290.355215:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050736768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355243:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050736768:12345-0@lo:400:kworker.0 Request processed in 29us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355248:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789403290.355259:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789403290.355263:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050736128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355288:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050736128:12345-0@lo:400:kworker.0 Request processed in 25us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355293:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789403290.355303:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789403290.355308:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050736640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355333:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050736640:12345-0@lo:400:kworker.0 Request processed in 25us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355347:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789403290.355370:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735616 00000100:00100000:1.0:1789403290.355374:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735616 00000100:00100000:1.0:1789403290.355417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735360 00000100:00100000:1.0:1789403290.355420:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735360 00000100:00100000:1.0:1789403290.355431:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050735872 00000100:00100000:1.0:1789403290.355433:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050735872 00000100:00100000:1.0:1789403290.355444:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736384 00000100:00100000:1.0:1789403290.355446:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736384 00000100:00100000:1.0:1789403290.355459:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736000 00000100:00100000:1.0:1789403290.355461:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736000 00000100:00100000:1.0:1789403290.355474:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736512 00000100:00100000:1.0:1789403290.355476:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736512 00000100:00100000:1.0:1789403290.355489:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789403290.355495:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050735616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355529:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050735616:12345-0@lo:400:kworker.0 Request processed in 33us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355534:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789403290.355546:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789403290.355552:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050735360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355579:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050735360:12345-0@lo:400:kworker.0 Request processed in 27us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355584:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789403290.355596:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789403290.355602:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050735872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355628:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050735872:12345-0@lo:400:kworker.0 Request processed in 26us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355633:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789403290.355653:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789403290.355660:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050736384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355689:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050736384:12345-0@lo:400:kworker.0 Request processed in 30us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355696:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789403290.355707:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789403290.355713:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050736000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355741:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050736000:12345-0@lo:400:kworker.0 Request processed in 29us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355747:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789403290.355759:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789403290.355764:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050736512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355791:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050736512:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403290.355797:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1789403290.355828:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403290.355834:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403290.355837:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403290.355839:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403290.355877:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050735488:0@lo:400:kworker.0 00010000:00080000:1.0:1789403290.355895:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431fd180 x1876325050736000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403290.355908:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050736000:0@lo:400:kworker.0 00010000:00080000:1.0:1789403290.355920:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281913100 x1876325050736512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403290.355944:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050736512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355959:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050735360:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355969:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050735872:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.355979:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050736384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.356039:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050735616:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.356050:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050736128:0@lo:400:kworker.0 00010000:00080000:1.0:1789403290.356061:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281912300 x1876325050736640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403290.356069:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050736640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.356079:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050735232:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.356088:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050735744:0@lo:400:kworker.0 00000100:00100000:1.0:1789403290.356098:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050736256:0@lo:400:kworker.0 00010000:00080000:1.0:1789403290.356109:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1436a4e00 x1876325050736768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403290.356117:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050736768:0@lo:400:kworker.0 00000100:00100000:3.0:1789403290.356510:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403290.356527:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050736896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403290.356573:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403290.356610:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050736896 00000100:00100000:3.0:1789403290.356616:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050736896 00000100:00100000:3.0:1789403290.356654:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789403290.356671:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050736896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403290.356700:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403290.356740:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050736896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403290.356747:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1789403290.356778:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f480 x1876325050736896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403290.356793:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050736896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403290.358697:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050737024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403290.358772:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403290.358871:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737024 00000100:00100000:3.0:1789403290.358882:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737024 00000100:00100000:3.0:1789403290.358943:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789403290.358954:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050737024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403290.358989:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403290.359057:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050737024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403290.359064:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1789403290.359109:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1440c3480 x1876325050737024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403290.359129:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050737024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789403291.123912:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403292.150876:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403293.169581:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403293.265485:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403293.265525:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403293.265560:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403293.265584:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403293.265623:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403293.265652:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062208 00000100:00100000:1.0:1789403293.265661:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062208 00000100:00100000:1.0:1789403293.265717:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062336 00000100:00100000:1.0:1789403293.265720:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062336 00000100:00100000:1.0:1789403293.265734:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062464 00000100:00100000:1.0:1789403293.265737:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062464 00000100:00100000:1.0:1789403293.265749:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062592 00000100:00100000:1.0:1789403293.265753:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062592 00000100:00100000:1.0:1789403293.265768:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 262 00000100:00100000:1.0:1789403293.265778:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038062208:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403293.265854:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038062208:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403293.265861:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 262 00000100:00100000:1.0:1789403293.265878:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 263 00000100:00100000:1.0:1789403293.265884:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038062336:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403293.265910:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038062336:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403293.265916:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 263 00000100:00100000:1.0:1789403293.265928:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 264 00000100:00100000:1.0:1789403293.265934:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038062464:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403293.265955:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038062464:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403293.265961:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 264 00000100:00100000:1.0:1789403293.265971:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 265 00000100:00100000:1.0:1789403293.265977:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038062592:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403293.266018:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038062592:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403293.266024:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 265 00000100:00080000:1.0:1789403293.266046:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403293.266050:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403293.266486:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062080 00000100:00100000:2.0:1789403293.266499:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062080 00000100:00100000:2.0:1789403293.266535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 376 00000100:00100000:2.0:1789403293.266542:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038062080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403293.266579:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038062080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 38us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403293.266586:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 376 00000100:00100000:0.0:1789403293.425709:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050737152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403293.425791:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403293.426334:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737152 00000100:00100000:3.0:1789403293.426342:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737152 00000100:00100000:3.0:1789403293.426423:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789403293.426435:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050737152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403293.426466:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403293.426636:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050737152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 204us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403293.426654:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789403293.426678:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403293.426722:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050737152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403293.426740:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403293.426748:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050737280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403293.426847:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403293.426880:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737280 00000100:00100000:3.0:1789403293.426884:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737280 00000100:00100000:3.0:1789403293.426910:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789403293.426916:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050737280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403293.426927:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403293.426957:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050737280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403293.426963:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789403293.426975:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403293.426993:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050737280:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789403293.707256:0:14041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:28:12 (1789403292) 00000100:00100000:3.0:1789403293.938818:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403293.938841:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050737408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403293.938910:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403293.942535:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737408 00000100:00100000:0.0:1789403293.942548:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737408 00000100:00100000:0.0:1789403293.942613:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789403293.942623:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050737408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789403293.942661:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789403293.942749:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050737408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (3838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403293.942756:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789403293.942822:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a28183aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050737408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789403294.194596:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403294.961894:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1437e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050737536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403294.961962:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403294.962122:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737536 00000100:00100000:2.0:1789403294.962132:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737536 00000100:00100000:2.0:1789403294.962195:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789403294.962205:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a28183aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050737536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403294.962237:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789403294.962294:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a28183aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050737536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403294.962301:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789403294.962412:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1437e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050737536:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403295.220481:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403295.473725:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403295.473749:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050737664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403295.473824:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403295.473902:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737664 00000100:00100000:2.0:1789403295.473910:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737664 00000100:00100000:2.0:1789403295.473965:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789403295.473977:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050737664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403295.474020:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403295.474063:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050737664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403295.474070:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789403295.474138:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789403295.474168:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f480 x1876325050737664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403295.474199:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050737664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403295.474614:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403295.474643:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403295.475173:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737792 00000100:00100000:3.0:1789403295.475188:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737792 00000100:00080000:2.0:1789403295.475295:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403295.476217:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789403295.476233:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050737792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403295.476260:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403295.476321:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050737792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403295.476328:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1789403295.476508:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a274f2f480 x1876325050737792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403295.476526:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403295.492859:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050737920:0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.492941:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403295.493099:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050737920 00000100:00100000:2.0:1789403295.493108:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050737920 00000100:00100000:2.0:1789403295.493157:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789403295.493166:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050737920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.493220:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050738048:0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.493260:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403295.493303:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738048 00000100:00100000:3.0:1789403295.493308:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738048 00000100:00100000:3.0:1789403295.493339:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789403295.493346:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050738048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.493384:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050738048:12345-0@lo:400:kworker.0 Request processed in 39us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403295.493416:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789403295.493456:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050738048:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.494543:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050738304:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.494584:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403295.494605:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050738816:0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.494650:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050738176:0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.494678:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403295.494694:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050738688:0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.494732:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403295.494747:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050739200:0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.494762:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403295.494801:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738304 00000100:00100000:3.0:1789403295.494807:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738304 00000100:00100000:3.0:1789403295.494843:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738688 00000100:00100000:3.0:1789403295.494845:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738688 00000100:00100000:3.0:1789403295.494865:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050739200 00000100:00100000:3.0:1789403295.494867:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050739200 00000100:00100000:3.0:1789403295.494880:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789403295.494886:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050738304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.494924:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050738304:12345-0@lo:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403295.494930:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789403295.494946:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789403295.494952:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050738688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403295.494996:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050738688:12345-0@lo:400:kworker.0 Request processed in 45us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403295.495002:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789403295.495014:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789403295.495019:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050739200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495037:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738176 00000100:00100000:0.0:1789403295.495041:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738176 00000100:00100000:3.0:1789403295.495047:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050739200:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403295.495053:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789403295.495078:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789403295.495085:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050738176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495120:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050738176:12345-0@lo:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403295.495133:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789403295.495178:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403295.495187:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050738560:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495212:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050738304:0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495212:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403295.495224:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050739072:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495235:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738816 00000100:00100000:1.0:1789403295.495238:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738816 00000100:00100000:0.0:1789403295.495253:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403295.495273:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789403295.495276:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789403295.495279:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050738432:0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495300:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403295.495318:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050738944:0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495337:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403295.495359:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738560 00000100:00100000:0.0:1789403295.495363:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738560 00000100:00100000:0.0:1789403295.495385:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050739072 00000100:00100000:0.0:1789403295.495408:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050739072 00000100:00100000:0.0:1789403295.495428:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789403295.495434:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050738560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495466:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050738560:12345-0@lo:400:kworker.0 Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403295.495472:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789403295.495484:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789403295.495490:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050739072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495514:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050739072:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403295.495520:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789403295.495540:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050738816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495546:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050738560:0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495564:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050739072:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495576:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050738816:12345-0@lo:400:kworker.0 Request processed in 294us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403295.495582:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789403295.495591:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738944 00000100:00100000:0.0:1789403295.495594:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738944 00000100:00100000:0.0:1789403295.495616:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789403295.495622:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050738816:0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495622:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050738944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495652:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050738432 00000100:00100000:0.0:1789403295.495654:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050738944:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403295.495655:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050738432 00000100:00100000:0.0:1789403295.495660:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789403295.495676:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789403295.495681:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050738944:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495682:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050738432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403295.495708:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050738176:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495716:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050738432:12345-0@lo:400:kworker.0 Request processed in 34us (415us total) trans 0 rc 0/0 00010000:00080000:0.0:1789403295.495720:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1440c3100 x1876325050738688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403295.495730:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789403295.495730:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050738688:0@lo:400:kworker.0 00010000:00080000:0.0:1789403295.495739:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a27a649500 x1876325050739200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403295.495748:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050739200:0@lo:400:kworker.0 00000100:00100000:1.0:1789403295.495752:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050738432:0@lo:400:kworker.0 00000100:00080000:0.0:1789403295.495813:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403295.495818:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403295.495820:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403295.496643:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050737920:0@lo:400:kworker.0 00000100:00100000:2.0:1789403295.496692:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050737920:12345-0@lo:400:kworker.0 Request processed in 3527us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403295.496700:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789403295.926344:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403295.928214:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062720 00000100:00100000:0.0:1789403295.928231:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062720 00000100:00100000:0.0:1789403295.928333:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1789403295.928344:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:11071:x1876325038062720:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403295.928714:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403295.928741:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128714 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.928809:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b760e97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.928823:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b760e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.928836:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b760e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789403295.928863:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789403295.928885:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403295.928890:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403295.928927:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b760e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.929058:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128714 expref: 7 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.929078:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b760e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128714 expref: 6 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.929086:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a243d8ba00) 00010000:00010000:0.0:1789403295.929089:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403295.929093:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1c00, rc 0) 00000100:00100000:0.0:1789403295.929228:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:11071:x1876325038062720:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 820us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403295.929250:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1789403295.959729:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403295.959816:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062848 00000100:00100000:0.0:1789403295.959827:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062848 00000100:00100000:0.0:1789403295.959915:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:0.0:1789403295.959926:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:11072:x1876325038062848:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403295.959956:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403295.959997:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12871b expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960077:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960092:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960111:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960133:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960140:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960148:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960234:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760eb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960260:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960269:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403295.960308:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403295.960312:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403295.960330:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960340:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960347:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960353:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960359:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403295.960363:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960370:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960382:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a243d8ba00) 00010000:00010000:0.0:1789403295.960429:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403295.960435:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960452:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960467:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960473:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960479:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960485:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403295.960488:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960494:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960502:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a243d8b900) 00010000:00010000:0.0:1789403295.960504:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403295.960507:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960513:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760eac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960560:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12871b expref: 8 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960575:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12871b expref: 7 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403295.960596:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a243d8b400) 00010000:00010000:0.0:1789403295.960599:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403295.960602:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1200, rc 0) 00000100:00100000:0.0:1789403295.960683:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11072:x1876325038062848:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 758us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403295.960698:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1789403295.969599:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403295.969794:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038062976 00000100:00100000:0.0:1789403295.969805:0:6511:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038062976 00000100:00100000:0.0:1789403295.969869:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1789403295.969880:0:6511:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11072:x1876325038062976:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789403295.969965:0:6511:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11072:x1876325038062976:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 86us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403295.969972:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1789403295.986707:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403295.986836:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038063232 00000100:00100000:3.0:1789403295.986847:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038063232 00000100:00100000:3.0:1789403295.986907:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1789403295.986917:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11072:x1876325038063232:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403295.986952:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403295.986973:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760eba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128722 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987083:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987097:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987108:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987155:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987347:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987356:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987628:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185200/0x5fb08b1e5b760ecf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987637:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185200/0x5fb08b1e5b760ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403295.987644:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185200/0x5fb08b1e5b760ecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403295.987650:0:6499:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:3.0:1789403296.003271:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789403296.003454:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003486:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003493:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003498:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403296.003503:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003510:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003526:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a243d8b400) 00010000:00010000:3.0:1789403296.003529:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403296.003534:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003539:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b760ec1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003553:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003558:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003563:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003567:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403296.003576:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003582:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003590:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a1434a9200) 00010000:00010000:3.0:1789403296.003593:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403296.003605:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.003612:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760ec8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.004017:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760eba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128722 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.004035:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185200/0x5fb08b1e5b760ecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128722 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403296.004042:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:3.0:1789403296.004044:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403296.004046:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185200, rc 0) 00000100:00100000:3.0:1789403296.004119:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11072:x1876325038063232:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 17203us (17432us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789403296.004129:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1789403296.025182:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403296.025494:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038063360 00000100:00100000:0.0:1789403296.025504:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038063360 00000100:00100000:0.0:1789403296.025572:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1789403296.025582:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11072:x1876325038063360:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789403296.025695:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11072:x1876325038063360:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 114us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403296.025702:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1789403296.041685:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403296.041790:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038063488 00000100:00100000:2.0:1789403296.041800:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038063488 00000100:00100000:2.0:1789403296.041875:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1789403296.041887:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:11072:x1876325038063488:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789403296.042217:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789403296.044489:0:6501:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2557us 00000100:00100000:1.0:1789403296.066623:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:11072:x1876325038063488:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 24727us (24935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403296.066637:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000040:00080000:0.0:1789403296.179200:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789403296.181558:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789403296.241795:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403297.265833:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403298.291977:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403298.376601:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.376724:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.376751:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.376771:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.376797:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.376826:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038063872 00000100:00100000:1.0:1789403298.376838:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038063872 00000100:00100000:1.0:1789403298.376900:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038064128 00000100:00100000:1.0:1789403298.376902:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038064128 00000100:00100000:1.0:1789403298.376913:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038063744 00000100:00100000:1.0:1789403298.376915:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038063744 00000100:00100000:1.0:1789403298.376927:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038064000 00000100:00100000:1.0:1789403298.376929:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038064000 00000100:00100000:1.0:1789403298.376943:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 272 00000100:00100000:1.0:1789403298.376953:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038063872:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403298.377068:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038063872:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.377094:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 272 00000100:00100000:1.0:1789403298.377112:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 273 00000100:00100000:1.0:1789403298.377118:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038064128:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403298.377140:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038064128:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.377154:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 273 00000100:00100000:1.0:1789403298.377163:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 274 00000100:00100000:1.0:1789403298.377169:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2388:x1876325038063744:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403298.377192:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2388:x1876325038063744:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.377198:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 274 00000100:00100000:1.0:1789403298.377207:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 275 00000100:00100000:1.0:1789403298.377212:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038064000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403298.377228:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038064000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 16us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.377234:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 275 00000100:00080000:1.0:1789403298.377450:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403298.377455:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403298.377753:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038063616 00000100:00100000:0.0:1789403298.377769:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038063616 00000100:00100000:0.0:1789403298.377820:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 378 00000100:00100000:0.0:1789403298.377829:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038063616:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403298.377878:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038063616:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 51us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403298.377885:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 378 00000100:00100000:1.0:1789403298.535659:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.535696:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038064256 00000100:00100000:1.0:1789403298.535706:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038064256 00000100:00100000:1.0:1789403298.535758:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:1.0:1789403298.535768:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11115:x1876325038064256:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403298.535789:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403298.535825:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128729 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535887:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535901:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535913:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535926:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535933:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535940:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.535993:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536001:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536006:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536012:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403298.536016:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536034:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536045:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a243d8ba00) 00010000:00010000:1.0:1789403298.536048:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403298.536053:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536060:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536072:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536078:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536084:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536089:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403298.536092:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536098:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536105:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a1425eb000) 00010000:00010000:1.0:1789403298.536108:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403298.536111:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536126:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760eeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536157:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760edd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128729 expref: 10 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536168:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a243d8ba00) 00010000:00010000:1.0:1789403298.536170:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403298.536174:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128729 expref: 10 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.536182:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063400, rc 0) 00000100:00100000:1.0:1789403298.536242:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11115:x1876325038064256:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 475us (591us total) trans 0 rc 301/301 00000100:00100000:1.0:1789403298.536249:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1789403298.550637:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050739328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403298.550725:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403298.550800:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403298.550810:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050739456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403298.550835:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403298.556235:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050739328 00000100:00100000:1.0:1789403298.556252:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050739328 00000100:00100000:0.0:1789403298.556361:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050739456 00000100:00100000:0.0:1789403298.556376:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050739456 00000100:00100000:1.0:1789403298.556473:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789403298.556485:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050739328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403298.556517:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403298.556611:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050739328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (5884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.556618:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789403298.556687:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050739328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789403298.559849:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403298.560050:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789403298.560062:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050739456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403298.560088:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403298.560163:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050739456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (9327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403298.560170:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789403298.560227:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050739456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403298.575999:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403298.576093:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038064512 00000100:00100000:2.0:1789403298.576104:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038064512 00000100:00100000:2.0:1789403298.576274:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:2.0:1789403298.576287:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11115:x1876325038064512:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:2.0:1789403298.576415:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403298.576442:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b760e97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128714 expref: 9 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.576459:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a243d8ba00) 00010000:00010000:2.0:1789403298.576470:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403298.576534:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.576548:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.576559:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.576572:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.576581:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.576588:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577422:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577435:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577444:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403298.577460:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002afa5ee reply state 00000000d1af0066 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577471:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577478:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403298.577481:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403298.577483:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789403298.577488:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789403298.577495:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577501:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577509:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577515:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403298.577520:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577542:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577551:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a141a01600) 00010000:00010000:2.0:1789403298.577554:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403298.577558:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577565:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760ef2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403298.577584:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002afa5ee reply state 00000000d1af0066 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577593:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.577600:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a141a01b00) 00010000:00010000:2.0:1789403298.577603:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403298.577605:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789403298.577729:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:11115:x1876325038064512:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1443us (1737us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789403298.577737:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1789403298.649341:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403298.649407:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038064640 00000100:00100000:3.0:1789403298.649418:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038064640 00000100:00100000:3.0:1789403298.649471:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403298.649481:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:11122:x1876325038064640:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:3.0:1789403298.649506:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403298.649531:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128730 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.649597:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760f0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.649613:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.649626:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403298.649673:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403298.649678:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403298.649722:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.649748:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b760f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128730 expref: 12 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.649766:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760f0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128730 expref: 11 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.649775:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:3.0:1789403298.649778:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403298.649788:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184600, rc 0) 00000100:00100000:3.0:1789403298.649845:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:11122:x1876325038064640:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 365us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403298.649853:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403298.703815:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.704019:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038064768 00000100:00100000:1.0:1789403298.704030:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038064768 00000100:00100000:1.0:1789403298.704108:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1789403298.704118:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:11129:x1876325038064768:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403298.704138:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403298.704158:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128737 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704218:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704231:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704244:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704255:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704262:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704268:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704350:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062e00/0x5fb08b1e5b760f2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704359:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062e00/0x5fb08b1e5b760f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704366:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062e00/0x5fb08b1e5b760f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403298.704457:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789403298.704461:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403298.704500:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062e00/0x5fb08b1e5b760f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704513:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704519:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704525:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704530:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403298.704534:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704542:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704553:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403298.704556:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403298.704561:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704567:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704580:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704596:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704602:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704606:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403298.704610:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704616:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704624:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a141a01b00) 00010000:00010000:1.0:1789403298.704627:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403298.704631:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704637:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760f23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704663:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b760f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128737 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704677:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062e00/0x5fb08b1e5b760f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128737 expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.704684:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403298.704686:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789403298.704697:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062e00, rc 0) 00000100:00100000:1.0:1789403298.704758:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:11129:x1876325038064768:12345-192.168.203.43@tcp:101:bash.0 Request processed in 641us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.704766:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:3.0:1789403298.719357:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403298.719575:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038065024 00000100:00100000:2.0:1789403298.719586:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038065024 00000100:00100000:2.0:1789403298.719648:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:2.0:1789403298.719660:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:11129:x1876325038065024:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403298.719681:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403298.719703:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760f31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12873e expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.719830:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.719845:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.719857:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.719895:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.719903:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.719909:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789403298.720266:0:6501:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789403298.720471:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.720482:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.720489:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403298.720496:0:6501:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:2.0:1789403298.723845:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:2.0:1789403298.729793:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729822:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729830:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729836:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403298.729841:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729849:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729866:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403298.729869:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403298.729873:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729879:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760f38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403298.729897:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f28acc32 reply state 00000000f8b75ff3 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729909:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.729916:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:2.0:1789403298.729919:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403298.729922:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789403298.729983:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760f31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.730006:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403298.730014:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:2.0:1789403298.730017:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403298.730019:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6e00, rc 0) 00000100:00100000:2.0:1789403298.730101:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11129:x1876325038065024:12345-192.168.203.43@tcp:101:bash.0 Request processed in 10443us (10754us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789403298.730110:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1789403298.758969:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.759082:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038065152 00000100:00100000:1.0:1789403298.759098:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038065152 00000100:00100000:1.0:1789403298.759165:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1789403298.759175:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876325038065152:12345-192.168.203.43@tcp:8:bash.0 00010000:00080000:1.0:1789403298.759211:0:8417:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:1.0:1789403298.759243:0:8417:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b760f54 00002000:00100000:1.0:1789403298.759255:0:8417:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4/ffff90a1436b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789403298.759278:0:8417:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789403298.759359:0:8417:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789403298.759639:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a1436b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403298.759939:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038065152:12345-192.168.203.43@tcp:8:bash.0 Request processed in 762us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403298.759948:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1789403298.761934:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403298.762054:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038065280 00000100:00100000:0.0:1789403298.762063:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038065280 00000100:00100000:0.0:1789403298.762167:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1789403298.762178:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038065280:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403298.762193:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403298.762216:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128745 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403298.762261:0:8563:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403298.762280:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1789403298.762284:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403298.762292:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 7 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403298.762311:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 7 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403298.762324:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0800, rc 0) 00000100:00100000:0.0:1789403298.762421:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:0:x1876325038065280:12345-192.168.203.43@tcp:101:bash.0 Request processed in 210us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403298.762430:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00080000:1.0:1789403298.763034:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403298.765833:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.766004:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038065408 00000100:00100000:1.0:1789403298.766023:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038065408 00000100:00100000:1.0:1789403298.766134:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1789403298.766145:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11129:x1876325038065408:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403298.766164:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403298.766185:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12874c expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.766217:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 8 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.766245:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403298.766250:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403298.766256:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.766291:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 8 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.766318:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 8 pid: 8563 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403298.766334:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8416:1876325050739584:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403298.766478:0:8416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403298.769209:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403298.769282:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038065536 00000100:00100000:3.0:1789403298.769291:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038065536 00010000:00010000:3.0:1789403298.769329:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 9 pid: 8563 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403298.769368:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1789403298.769379:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a607850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2389:x1876325038065536:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403298.769414:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403298.769435:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 9 pid: 8563 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.769457:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 9 pid: 8563 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.769481:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403298.769485:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403298.769492:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.769519:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403298.769553:0:10319:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403298.769566:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a259990a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10319:1876325050739712:192.168.203.43@tcp:105: 00000100:00100000:3.0:1789403298.769639:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149480 going to sleep for 11 seconds 00010000:00010000:1.0:1789403298.770203:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a2444b3/0x5fb08b1e5b760f5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128745 expref: 9 pid: 8563 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403298.770221:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8416:1876325050739584:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403298.770243:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.770253:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062400, rc 0) 00000100:00100000:1.0:1789403298.770294:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:11129:x1876325038065408:12345-192.168.203.43@tcp:101:bash.0 Request processed in 4151us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403298.770311:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403298.776920:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a259990a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10319:1876325050739712:192.168.203.43@tcp:105: 00010000:00010000:3.0:1789403298.776962:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403298.777023:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a607850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038065536:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 7644us (7819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403298.777034:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1789403298.783491:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403298.783576:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038065792 00000100:00100000:0.0:1789403298.783585:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038065792 00000100:00100000:0.0:1789403298.783635:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1789403298.783643:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11129:x1876325038065792:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:0.0:1789403298.783930:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11129:x1876325038065792:12345-192.168.203.43@tcp:35:bash.0 Request processed in 286us (446us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789403298.783938:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1789403298.903778:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403298.903884:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038066048 00000100:00100000:1.0:1789403298.903894:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038066048 00000100:00100000:1.0:1789403298.903968:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:1.0:1789403298.903978:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11139:x1876325038066048:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403298.904002:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403298.904025:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128753 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403298.904124:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789403298.904240:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128753 expref: 18 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.904254:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403298.904257:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403298.904262:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128753 expref: 18 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403298.904275:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063200, rc 0) 00000100:00100000:1.0:1789403298.904337:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:11139:x1876325038066048:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 360us (569us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1789403298.904344:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:2.0:1789403298.909900:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403298.910001:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038066304 00000100:00100000:0.0:1789403298.910011:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038066304 00000100:00100000:0.0:1789403298.910081:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:0.0:1789403298.910091:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:11139:x1876325038066304:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1789403298.910340:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:11139:x1876325038066304:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 249us (449us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789403298.910347:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403299.021021:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403299.021173:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038066432 00000100:00100000:0.0:1789403299.021183:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038066432 00000100:00100000:0.0:1789403299.021239:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:0.0:1789403299.021249:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:11145:x1876325038066432:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403299.021274:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403299.021294:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12875a expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.021531:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760f7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.021546:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.021559:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403299.021601:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789403299.021605:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403299.021624:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760f7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.021651:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b760f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12875a expref: 20 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.021734:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760f7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12875a expref: 19 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.021757:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403299.021760:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403299.021763:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0800, rc 0) 00000100:00100000:0.0:1789403299.021822:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11145:x1876325038066432:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 574us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403299.021829:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1789403299.036542:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.036948:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038066688 00000100:00100000:2.0:1789403299.036967:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038066688 00000100:00100000:2.0:1789403299.037064:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1789403299.037075:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11145:x1876325038066688:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403299.037097:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403299.037118:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b760f85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128761 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.037229:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b760f8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.037243:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b760f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.037254:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b760f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403299.037282:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000004:00020000:2.0:1789403299.037292:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:2.0:1789403299.037426:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b760f85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128761 expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.037448:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b760f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128761 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.037455:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:2.0:1789403299.037458:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403299.037462:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7c00, rc 0) 00000100:00100000:2.0:1789403299.037574:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:11145:x1876325038066688:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 501us (1042us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789403299.037581:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1789403299.048301:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.048404:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403299.048483:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067072 00000100:00100000:0.0:1789403299.048492:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067072 00000100:00100000:0.0:1789403299.048550:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1789403299.048559:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:2388:x1876325038067072:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403299.048575:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403299.048609:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b760f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128761 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.048630:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:0.0:1789403299.048635:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403299.048701:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:2388:x1876325038067072:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 143us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403299.048708:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:1.0:1789403299.050365:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038066944 00000100:00100000:1.0:1789403299.050375:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038066944 00000100:00100000:1.0:1789403299.050506:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1789403299.050516:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11145:x1876325038066944:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403299.050552:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403299.050571:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128768 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.050686:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fa1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.050706:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.050716:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403299.050726:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000004:00020000:1.0:1789403299.050733:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:1.0:1789403299.050812:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760f9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128768 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.050834:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128768 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.050842:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:1.0:1789403299.050845:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789403299.050848:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063600, rc 0) 00000100:00100000:1.0:1789403299.050913:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11145:x1876325038066944:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 399us (2680us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789403299.050920:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:0.0:1789403299.063797:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050739840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403299.063880:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403299.064060:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050739840 00000100:00100000:1.0:1789403299.064069:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050739840 00000100:00100000:1.0:1789403299.064157:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789403299.064167:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050739840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403299.064201:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403299.064264:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050739840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403299.064271:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789403299.064316:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050739840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403299.064787:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403299.064887:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067200 00000100:00100000:3.0:1789403299.064893:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067200 00000100:00100000:3.0:1789403299.064934:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1789403299.064942:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038067200:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:3.0:1789403299.064988:0:8563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.065009:0:8563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 7 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.065027:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789403299.065031:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403299.065036:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.065304:0:8563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 7 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.065323:0:8563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 7 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403299.065338:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a259991f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8563:1876325050739968:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403299.065445:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403299.075736:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403299.075907:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a259991f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8563:1876325050739968:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403299.075936:0:8563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403299.076032:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067328 00000100:00100000:0.0:1789403299.076039:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067328 00002000:00100000:0.0:1789403299.076081:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff90a250e29c00 x1876325038067328/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:460/0 lens 504/0 e 0 to 0 dl 1789403310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789403299.076114:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a250e29c00 with x1876325038067328 ext(0->12) 00010000:00010000:0.0:1789403299.076122:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 8 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.076136:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 8 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403299.076157:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a250e29c00 00000100:00100000:0.0:1789403299.076192:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1789403299.076202:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038067328:12345-192.168.203.43@tcp:4:lfs.0 00000001:00100000:2.0:1789403299.085226:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000100:00100000:0.0:1789403299.088545:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2389:x1876325038067328:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 12333us (12807us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789403299.088559:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:0.0:1789403299.088573:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff90a250e29c00 x1876325038067328/t4294967300(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:460/0 lens 504/448 e 0 to 0 dl 1789403310 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789403299.088584:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a250e29c00 with x1876325038067328 ext(0->12) 00010000:00010000:0.0:1789403299.088596:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.088618:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403299.088627:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a250e29c00 00000100:00100000:0.0:1789403299.093063:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.093429:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067456 00000100:00100000:2.0:1789403299.093440:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067456 00010000:00010000:2.0:1789403299.093491:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403299.093535:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1789403299.093545:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2387:x1876325038067456:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403299.093562:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789403299.093588:0:6487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789403299.093592:0:6487:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789403298 00002000:00010000:2.0:1789403299.093594:0:6487:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789403299 00002000:00010000:2.0:1789403299.093597:0:6487:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789403298 00002000:00010000:2.0:1789403299.093599:0:6487:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789403299.093607:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.093622:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.093651:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861ff76a/0x5fb08b1e5b760f62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12874c expref: 9 pid: 8416 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.093679:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403299.093683:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403299.093688:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.093698:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.093728:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403299.093778:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2387:x1876325038067456:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 234us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403299.093786:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00010000:00010000:0.0:1789403299.094047:0:8563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094056:0:8563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094086:0:8563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094094:0:8563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094101:0:8563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094107:0:8563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403299.094112:0:8563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094120:0:8563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094133:0:8563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.094149:0:8563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b760faf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403299.094625:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038067200:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 29683us (29839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403299.094634:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:1.0:1789403299.112913:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403299.113031:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067712 00000100:00100000:0.0:1789403299.113053:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067712 00000100:00100000:0.0:1789403299.113147:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1789403299.113158:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11145:x1876325038067712:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:0.0:1789403299.113257:0:6502:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128768 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403299.113511:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789403299.113560:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789403299.113869:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789403299.113907:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.113923:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.113933:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.113982:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.113997:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 26 pid: 6501 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403299.114024:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e04e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6502:1876325050740096:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403299.114102:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657540 going to sleep for 11 seconds 00000100:00100000:1.0:1789403299.118590:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e04e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6502:1876325050740096:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403299.118637:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403299.125744:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403299.126062:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067840 00000100:00100000:3.0:1789403299.126073:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067840 00010000:00010000:3.0:1789403299.126118:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 27 pid: 6501 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403299.126164:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1789403299.126183:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:2390:x1876325038067840:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403299.126219:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403299.126228:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 27 pid: 6501 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.126252:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 27 pid: 6501 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.126278:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b760f46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12873e expref: 27 pid: 6501 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.126301:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:3.0:1789403299.126306:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.126316:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.126325:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.126361:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403299.126496:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:2390:x1876325038067840:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 315us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403299.126504:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00010000:00010000:1.0:1789403299.127435:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.127447:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403299.127576:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789403299.127713:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789403299.127803:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050740224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789403299.127875:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403299.128096:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403299.133974:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050740224 00000100:00100000:2.0:1789403299.134010:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050740224 00000100:00100000:2.0:1789403299.134365:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789403299.134380:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050740224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789403299.134779:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050740224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 219us (6719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403299.134790:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789403299.136273:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050740224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789403299.136542:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789403299.137370:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e06680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050740352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789403299.137521:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403299.137552:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a143657f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403299.138426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050740352 00000100:00100000:2.0:1789403299.138439:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050740352 00000100:00100000:2.0:1789403299.138502:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789403299.138513:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050740352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789403299.138841:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6502:x1876325050740352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 330us (1319us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789403299.138850:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789403299.139025:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e06680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050740352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789403299.139091:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789403299.139132:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.139155:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.139162:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.139176:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403299.139181:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.139190:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.139206:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:0.0:1789403299.139209:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789403299.139232:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.139238:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b760fb6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789403299.140090:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789403299.140148:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789403299.140160:0:6502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345138770574ns, next at 346138768510ns, rc = 0 00000001:00080000:0.0:1789403299.140178:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789403299.140208:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01700) 00010000:00010000:0.0:1789403299.140211:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789403299.140218:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fa1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128768 expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403299.140670:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:11145:x1876325038067712:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 27500us (27753us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789403299.140679:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000020:00080000:0.0:1789403299.140685:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789403299.144815:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.145026:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038067968 00000100:00100000:2.0:1789403299.145037:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038067968 00000100:00100000:2.0:1789403299.145132:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1789403299.145152:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:11145:x1876325038067968:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403299.145177:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403299.145200:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760fbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12876f expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.145270:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760fbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12876f expref: 30 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.145285:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760fbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12876f expref: 30 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.145329:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403299.145332:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403299.145336:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6800, rc 0) 00000100:00080000:1.0:1789403299.145384:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403299.145400:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11145:x1876325038067968:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 246us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403299.145407:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1789403299.149492:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.150335:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038068224 00000100:00100000:1.0:1789403299.150346:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038068224 00000100:00100000:1.0:1789403299.150457:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1789403299.150468:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11145:x1876325038068224:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403299.150996:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+31:11145:x1876325038068224:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 526us (1509us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789403299.151005:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000040:00080000:2.0:1789403299.252008:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789403299.252821:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789403299.281592:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.281928:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038068480 00000100:00100000:2.0:1789403299.281938:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038068480 00000100:00100000:2.0:1789403299.282007:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1789403299.282017:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+31:11155:x1876325038068480:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403299.282044:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403299.282065:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128776 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403299.282172:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789403299.282270:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760fc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128776 expref: 33 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.282284:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403299.282287:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403299.282293:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b760fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128776 expref: 33 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.282305:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6000, rc 0) 00000100:00100000:2.0:1789403299.282413:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11155:x1876325038068480:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 373us (807us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789403299.282421:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1789403299.286004:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.286100:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038068608 00000100:00100000:1.0:1789403299.286110:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038068608 00000100:00100000:1.0:1789403299.286178:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1789403299.286189:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11155:x1876325038068608:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:1.0:1789403299.286268:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286286:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286297:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286310:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286318:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286324:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286449:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286478:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286486:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403299.286538:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286551:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286559:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286565:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286571:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403299.286575:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286583:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286595:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403299.286598:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403299.286604:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286610:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760fd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286632:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286638:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286645:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286650:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403299.286653:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286833:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286844:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:1.0:1789403299.286847:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403299.286850:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286856:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286867:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286873:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286878:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286889:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403299.286892:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286898:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286907:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403299.286909:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403299.286912:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.286918:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403299.286998:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11155:x1876325038068608:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 810us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403299.287006:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:0.0:1789403299.289613:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.289770:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038068864 00000100:00100000:1.0:1789403299.289780:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038068864 00000100:00100000:1.0:1789403299.289833:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1789403299.289844:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11155:x1876325038068864:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403299.290062:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:11155:x1876325038068864:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 219us (471us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789403299.290069:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00010000:00010000:0.0:1789403299.316201:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403299.342548:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.342712:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038069120 00000100:00100000:1.0:1789403299.342723:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038069120 00000100:00100000:1.0:1789403299.342785:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1789403299.342810:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:11158:x1876325038069120:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403299.342835:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403299.342854:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12877d expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.342925:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.342937:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.342948:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.342968:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.342974:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.342980:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343080:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343088:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343095:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403299.343110:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:1.0:1789403299.343116:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000004:00020000:1.0:1789403299.343126:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:1.0:1789403299.343194:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343201:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343208:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343213:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403299.343218:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343226:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343238:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403299.343241:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403299.343246:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343251:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b760fee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343263:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343269:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343281:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343286:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403299.343289:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343296:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343304:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:1.0:1789403299.343307:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403299.343310:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343315:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b760ff5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343352:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b760fe7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 36 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343365:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 35 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.343372:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403299.343374:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403299.343377:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063200, rc 0) 00000100:00100000:1.0:1789403299.343498:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11158:x1876325038069120:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 689us (960us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789403299.343515:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:3.0:1789403299.349644:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403299.349801:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038069248 00000100:00100000:0.0:1789403299.349812:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038069248 00000100:00100000:0.0:1789403299.349874:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1789403299.349885:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11158:x1876325038069248:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1789403299.349961:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.349978:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.349998:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350034:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350041:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350049:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350055:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403299.350059:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350066:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350077:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403299.350080:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789403299.350084:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.350090:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b76100a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403299.350176:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11158:x1876325038069248:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 293us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403299.350184:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:3.0:1789403299.353198:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.353450:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038069504 00000100:00100000:1.0:1789403299.353462:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038069504 00000100:00100000:1.0:1789403299.353520:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:1.0:1789403299.353530:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11158:x1876325038069504:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403299.353804:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:11158:x1876325038069504:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 274us (615us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789403299.353812:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1789403299.613744:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.613940:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038069760 00000100:00100000:1.0:1789403299.613958:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038069760 00000100:00100000:1.0:1789403299.614032:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1789403299.614043:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:11189:x1876325038069760:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:1.0:1789403299.614067:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403299.614087:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128784 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.614201:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761018 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.614217:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.614228:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403299.614239:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000004:00020000:1.0:1789403299.614247:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:1.0:1789403299.614360:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128784 expref: 39 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.614711:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761018 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128784 expref: 38 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403299.614719:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403299.614723:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403299.614726:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063800, rc 0) 00000100:00100000:1.0:1789403299.614865:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11189:x1876325038069760:12345-192.168.203.43@tcp:101:cat.0 Request processed in 822us (1129us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789403299.614872:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1789403299.621342:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403299.621533:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038069888 00000100:00100000:0.0:1789403299.621563:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038069888 00000100:00100000:0.0:1789403299.621633:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1789403299.621644:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:2387:x1876325038069888:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403299.621672:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403299.621697:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761018 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128784 expref: 38 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403299.621716:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403299.621721:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403299.621783:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:2387:x1876325038069888:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 140us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403299.621790:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1789403299.624321:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403299.624426:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038070144 00000100:00100000:1.0:1789403299.624436:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038070144 00000100:00100000:1.0:1789403299.624486:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1789403299.624496:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:11189:x1876325038070144:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:1.0:1789403299.624780:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11189:x1876325038070144:12345-192.168.203.43@tcp:35:cat.0 Request processed in 284us (465us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789403299.624788:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:1.0:1789403299.719161:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.719279:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038070400 00000100:00100000:2.0:1789403299.719295:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038070400 00000100:00100000:2.0:1789403299.719376:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1789403299.719419:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11195:x1876325038070400:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:2.0:1789403299.719444:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403299.719447:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789403299.719473:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b760f7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12875a expref: 38 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.719499:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403299.719504:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403299.719516:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761026 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12878b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.719613:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.719626:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 38 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.719634:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.719664:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 38 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.719708:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 38 pid: 9061 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403299.719723:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050740480:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403299.719837:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2616433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403299.726437:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050740480:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403299.726466:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403299.733790:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403299.734001:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038070528 00000100:00100000:3.0:1789403299.734011:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038070528 00010000:00010000:3.0:1789403299.734070:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 39 pid: 9061 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403299.734116:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1789403299.734128:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:2390:x1876325038070528:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403299.734157:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403299.734164:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 39 pid: 9061 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.734187:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 39 pid: 9061 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.734209:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b760ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12877d expref: 39 pid: 9061 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.734227:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403299.734233:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.734242:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.734251:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.734305:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403299.734365:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:2390:x1876325038070528:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 237us (581us total) trans 0 rc 0/0 00010000:00010000:2.0:1789403299.734370:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403299.734376:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00010000:00010000:2.0:1789403299.734384:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403299.734431:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000004:00020000:2.0:1789403299.734449:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:2.0:1789403299.761635:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761026 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 39 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.761666:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 38 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.761677:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403299.761680:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789403299.761684:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7a00, rc 0) 00000100:00100000:2.0:1789403299.761769:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11195:x1876325038070400:12345-192.168.203.43@tcp:101:dd.0 Request processed in 42382us (42632us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789403299.761792:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403299.765747:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403299.765821:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038070656 00000100:00100000:2.0:1789403299.765830:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038070656 00000100:00100000:2.0:1789403299.765884:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:2.0:1789403299.765895:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11195:x1876325038070656:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:2.0:1789403299.765917:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403299.765938:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76103b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128792 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.765984:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.765998:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.766010:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.766133:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76103b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 40 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.766150:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 39 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403299.766159:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403299.766162:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403299.766166:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6400, rc 0) 00000100:00100000:2.0:1789403299.766244:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:11195:x1876325038070656:12345-192.168.203.43@tcp:101:dd.0 Request processed in 350us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403299.766267:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1789403299.770669:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403299.770732:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038070912 00000100:00100000:3.0:1789403299.770741:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038070912 00000100:00100000:3.0:1789403299.770793:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1789403299.770801:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:11195:x1876325038070912:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:3.0:1789403299.771018:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.771035:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.771046:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789403299.771089:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789403299.771112:0:9061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000559042a2 reply state 00000000ad410217 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.771124:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403299.771132:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403299.771134:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789403299.771138:0:9061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789403299.771242:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:11195:x1876325038070912:12345-192.168.203.43@tcp:36:dd.0 Request processed in 441us (584us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789403299.771273:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000020:00080000:3.0:1789403299.771278:0:9061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789403300.082560:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403300.082586:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050740608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403300.082690:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.082824:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050740608 00000100:00100000:2.0:1789403300.082834:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050740608 00000100:00100000:2.0:1789403300.082888:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789403300.082899:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050740608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403300.082935:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1789403300.083008:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050740608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.083016:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789403300.084174:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050740608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403300.113375:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403300.113559:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038071040 00000100:00100000:2.0:1789403300.113569:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038071040 00000100:00100000:2.0:1789403300.113643:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:2.0:1789403300.113654:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:11210:x1876325038071040:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:2.0:1789403300.113677:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403300.113698:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761050 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128799 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113766:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113781:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113795:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113806:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113830:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113837:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113905:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113915:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 43 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113924:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113965:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 43 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.113978:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 43 pid: 6501 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403300.113992:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050740736:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403300.114088:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2616433c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789403300.114817:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403300.120033:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403300.120338:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038071296 00000100:00100000:0.0:1789403300.120348:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038071296 00000100:00100000:0.0:1789403300.120437:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1789403300.120448:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+44:6159:x1876325038071296:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789403300.120745:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+45:6159:x1876325038071296:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 298us (720us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789403300.120752:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1789403300.124849:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050740736:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403300.124883:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403300.127124:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403300.127538:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038071424 00000100:00100000:0.0:1789403300.127548:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038071424 00010000:00010000:0.0:1789403300.127589:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 45 pid: 6501 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403300.127633:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:0.0:1789403300.127671:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+45:2390:x1876325038071424:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403300.127686:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403300.127694:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 45 pid: 6501 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.127707:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 45 pid: 6501 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.127728:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b76102d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12878b expref: 45 pid: 6501 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.127746:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403300.127751:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.127762:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.127769:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.127965:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403300.128028:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+44:2390:x1876325038071424:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 370us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403300.128036:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00010000:00010000:2.0:1789403300.144225:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144263:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403300.144327:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789403300.144332:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403300.144378:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144409:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144419:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144426:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144434:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144441:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403300.144445:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144452:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144466:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403300.144470:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403300.144475:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144493:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761057 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144510:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144517:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144523:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144528:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403300.144531:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144537:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144544:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:2.0:1789403300.144547:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403300.144550:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144555:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76105e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144592:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761050 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128799 expref: 44 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144607:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128799 expref: 43 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.144623:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403300.144625:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403300.144627:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7200, rc 0) 00000100:00100000:2.0:1789403300.144717:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:11210:x1876325038071040:12345-192.168.203.43@tcp:101:stat.0 Request processed in 31063us (31351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.144725:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1789403300.227643:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.227842:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038071680 00000100:00100000:1.0:1789403300.227856:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038071680 00000100:00100000:1.0:1789403300.227936:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:1.0:1789403300.227960:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:11216:x1876325038071680:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:1.0:1789403300.228040:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403300.228075:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b761065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128799 expref: 43 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.228100:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403300.228107:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403300.228342:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.228359:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.228370:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403300.228481:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789403300.228504:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baa08f46 reply state 000000008724eecf transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.228518:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.228525:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403300.228528:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403300.228544:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403300.229265:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+45:11216:x1876325038071680:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 1312us (1630us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789403300.229276:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000020:00080000:1.0:1789403300.229283:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789403300.337782:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403300.382562:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.383190:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038071808 00000100:00100000:1.0:1789403300.383210:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038071808 00000100:00100000:1.0:1789403300.383297:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1789403300.383311:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+45:11230:x1876325038071808:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:1.0:1789403300.383350:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403300.383384:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761073 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287a0 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383533:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383555:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383571:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383583:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383591:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383597:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383707:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383735:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383743:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403300.383802:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789403300.383808:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403300.383837:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383852:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383862:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383869:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383876:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383883:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403300.383888:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383897:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383913:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403300.383923:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403300.383932:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383959:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76107a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383978:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383984:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383990:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.383995:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403300.383997:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.384003:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.384861:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:1.0:1789403300.384871:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403300.384878:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.384886:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761081 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.385092:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761073 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 47 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.385133:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 46 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.385141:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403300.385144:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403300.385146:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:1.0:1789403300.387604:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+46:11230:x1876325038071808:12345-192.168.203.43@tcp:101:stat.0 Request processed in 4276us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403300.387622:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1789403300.502384:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403300.502625:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038072064 00000100:00100000:2.0:1789403300.502639:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038072064 00000100:00100000:2.0:1789403300.502725:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:2.0:1789403300.502736:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+46:11240:x1876325038072064:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403300.502766:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403300.502793:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76108f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287a7 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403300.502928:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789403300.503072:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76108f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a7 expref: 48 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.503094:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403300.503098:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403300.503104:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76108f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a7 expref: 48 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.503120:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6600, rc 0) 00000100:00100000:2.0:1789403300.503207:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:11240:x1876325038072064:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 471us (837us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789403300.503232:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1789403300.507331:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403300.507541:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038072320 00000100:00100000:0.0:1789403300.507554:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038072320 00000100:00100000:0.0:1789403300.507632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1789403300.507645:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:11240:x1876325038072320:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1789403300.508218:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+48:11240:x1876325038072320:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 574us (909us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789403300.508227:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:3.0:1789403300.588880:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.589119:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038072576 00000100:00100000:1.0:1789403300.589133:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038072576 00000100:00100000:1.0:1789403300.589209:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1789403300.589222:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+48:11246:x1876325038072576:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403300.589256:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403300.589282:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b76109d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287ae expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.589501:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.589520:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 49 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.589531:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.589576:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 49 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.589600:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 49 pid: 9061 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403300.589617:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050740864:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403300.590001:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403300.594089:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403300.594128:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050740992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403300.594229:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789403300.594620:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346593229742ns, next at 347593225772ns, rc = 0 00000100:00100000:3.0:1789403300.594649:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050741120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403300.594684:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.594900:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050740992 00000100:00100000:2.0:1789403300.594911:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050740992 00000100:00100000:2.0:1789403300.594991:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741120 00000100:00100000:2.0:1789403300.594994:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741120 00000100:00100000:2.0:1789403300.595012:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789403300.595022:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050740992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403300.595061:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789403300.595119:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050740992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.595128:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789403300.595150:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789403300.595156:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050741120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789403300.595165:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789403300.595205:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050741120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.595211:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789403300.595256:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050741120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403300.595288:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050740992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403300.597927:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050741248:0@lo:400:kworker.0 00000100:00100000:1.0:1789403300.598021:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789403300.598200:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403300.598234:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050741632:0@lo:400:kworker.0 00000100:00100000:3.0:1789403300.598274:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403300.598319:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050741376:0@lo:400:kworker.0 00000100:00100000:3.0:1789403300.598348:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403300.598369:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403300.598375:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050741504:0@lo:400:kworker.0 00000100:00100000:3.0:1789403300.598421:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403300.598454:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741632 00000100:00100000:3.0:1789403300.598463:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741632 00000100:00100000:3.0:1789403300.598527:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789403300.598539:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050741632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403300.599771:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050741632:12345-0@lo:400:kworker.0 Request processed in 1227us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403300.599807:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789403300.600024:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050741632:0@lo:400:kworker.0 00000100:00100000:1.0:1789403300.600079:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741376 00000100:00100000:1.0:1789403300.600086:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741376 00000100:00100000:1.0:1789403300.600130:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741504 00000100:00100000:1.0:1789403300.600134:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741504 00000100:00100000:3.0:1789403300.600155:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.600155:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789403300.600164:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050741376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403300.600290:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741248 00000100:00100000:0.0:1789403300.600296:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741248 00000100:00100000:0.0:1789403300.600331:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789403300.600339:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050741248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403300.600444:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038072704 00000100:00100000:3.0:1789403300.600448:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038072704 00010000:00010000:3.0:1789403300.600480:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 50 pid: 9061 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403300.600510:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:3.0:1789403300.600528:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a607450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+50:2389:x1876325038072704:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403300.600541:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403300.600549:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 50 pid: 9061 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.600563:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 50 pid: 9061 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403300.601118:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050741376:12345-0@lo:400:kworker.0 Request processed in 951us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403300.601127:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789403300.601146:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789403300.601155:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050741504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403300.601191:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050741504:12345-0@lo:400:kworker.0 Request processed in 38us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403300.601196:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789403300.601240:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050740864:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403300.601436:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050742144:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.601496:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.601532:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789403300.601539:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050741760:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.601566:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.601610:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050742272:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.601634:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.601667:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741760 00000100:00100000:2.0:1789403300.601673:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741760 00000100:00100000:2.0:1789403300.601722:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050742272 00000100:00100000:2.0:1789403300.601929:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050742272 00000100:00100000:2.0:1789403300.601966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789403300.601974:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050741760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602020:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050741760:12345-0@lo:400:kworker.0 Request processed in 47us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.602027:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789403300.602060:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050741760:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602080:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789403300.602087:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050742272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602120:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050742272:12345-0@lo:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.602126:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789403300.602145:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050742272:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602219:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050741888:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602247:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.602264:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050742400:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602283:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.602305:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050741504:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602317:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050741376:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602341:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403300.602347:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050742016:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602373:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403300.602424:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050741888 00000100:00100000:2.0:1789403300.602429:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050741888 00000100:00100000:2.0:1789403300.602447:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050742400 00000100:00100000:2.0:1789403300.602450:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050742400 00000100:00100000:2.0:1789403300.602465:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789403300.602472:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050741888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602505:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050741888:12345-0@lo:400:kworker.0 Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.602512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:2.0:1789403300.602536:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a250e2ad80 x1876325050741888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403300.602548:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050741888:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602564:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789403300.602571:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050742400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.602600:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050742400:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.602606:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00080000:2.0:1789403300.602626:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a250e2a680 x1876325050742400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403300.602636:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050742400:0@lo:400:kworker.0 00000100:00080000:2.0:1789403300.602982:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403300.602987:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403300.603042:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050742144 00000100:00100000:2.0:1789403300.603047:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050742144 00000100:00100000:2.0:1789403300.603079:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050742016 00000100:00100000:2.0:1789403300.603082:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050742016 00000100:00100000:2.0:1789403300.603102:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789403300.603107:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050742144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.603151:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050742144:12345-0@lo:400:kworker.0 Request processed in 43us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.603157:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789403300.603168:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789403300.603174:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050742016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.603205:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050742016:12345-0@lo:400:kworker.0 Request processed in 31us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.603210:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1789403300.603221:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403300.603241:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050742144:0@lo:400:kworker.0 00000100:00100000:2.0:1789403300.603262:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050742016:0@lo:400:kworker.0 00000100:00100000:0.0:1789403300.605739:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a25282f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050741248:12345-0@lo:400:kworker.0 Request processed in 5386us (7703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403300.605758:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789403300.606018:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050741248:0@lo:400:kworker.0 00010000:00010000:1.0:1789403300.606535:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.607306:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287a0 expref: 50 pid: 9061 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.607332:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403300.607338:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.607351:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.607375:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.607452:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403300.607779:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a607450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:2389:x1876325038072704:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 7260us (7624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403300.607791:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00010000:00010000:1.0:1789403300.608364:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.608377:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403300.608424:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00020000:1.0:1789403300.608449:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789403300.608618:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b76109d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 50 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.608640:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 49 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.608650:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403300.608653:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403300.608657:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063a00, rc 0) 00000100:00100000:1.0:1789403300.608733:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:11246:x1876325038072576:12345-192.168.203.43@tcp:101:bash.0 Request processed in 19507us (19860us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789403300.608742:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:2.0:1789403300.619807:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403300.625721:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038072960 00000100:00100000:0.0:1789403300.625743:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038072960 00000100:00100000:0.0:1789403300.625825:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1789403300.625837:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:11246:x1876325038072960:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:0.0:1789403300.626130:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.626151:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.626165:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403300.626274:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1789403300.626297:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb430f11 reply state 00000000a586f97e transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.626326:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.626334:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403300.626337:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403300.626341:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789403300.627406:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:11246:x1876325038072960:12345-192.168.203.43@tcp:36:bash.0 Request processed in 1549us (7591us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789403300.627418:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000020:00080000:0.0:1789403300.627425:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789403300.642352:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403300.642703:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038073088 00000100:00100000:2.0:1789403300.642717:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038073088 00000100:00100000:2.0:1789403300.642798:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1789403300.642812:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:11246:x1876325038073088:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403300.642848:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403300.642875:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287b5 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.643029:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.643048:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 53 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.643057:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.643100:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 53 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.643127:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 53 pid: 6500 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403300.643145:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050742528:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403300.643458:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403300.646721:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050742528:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403300.646763:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403300.659817:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.660884:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038073216 00000100:00100000:1.0:1789403300.660903:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038073216 00010000:00010000:1.0:1789403300.660978:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 54 pid: 6500 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403300.661035:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:1.0:1789403300.661047:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:2390:x1876325038073216:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403300.661088:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403300.661097:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 54 pid: 6500 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.661112:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 54 pid: 6500 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.661140:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ae expref: 54 pid: 6500 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.661161:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403300.661177:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.661190:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.661199:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.661238:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403300.661323:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:2390:x1876325038073216:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 277us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403300.661331:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00010000:00010000:2.0:1789403300.661899:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.661912:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403300.661995:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789403300.662011:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403300.662042:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.662085:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287b5 expref: 53 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.662104:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287b5 expref: 52 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.662112:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403300.662115:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403300.662118:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7400, rc 0) 00000100:00100000:2.0:1789403300.662179:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:11246:x1876325038073088:12345-192.168.203.43@tcp:101:bash.0 Request processed in 19370us (19842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.662187:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1789403300.669050:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.669180:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038073472 00000100:00100000:1.0:1789403300.669192:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038073472 00000100:00100000:1.0:1789403300.669265:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:1.0:1789403300.669276:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:11246:x1876325038073472:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1789403300.669594:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:11246:x1876325038073472:12345-192.168.203.43@tcp:35:bash.0 Request processed in 319us (556us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789403300.669601:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1789403300.797149:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.797268:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038073728 00000100:00100000:1.0:1789403300.797283:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038073728 00000100:00100000:1.0:1789403300.797454:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:1.0:1789403300.797466:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:11256:x1876325038073728:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403300.797501:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403300.797530:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287bc expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403300.797663:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789403300.797795:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287bc expref: 55 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.797813:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403300.797817:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403300.797824:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7610c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287bc expref: 55 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403300.797839:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063a00, rc 0) 00000100:00100000:1.0:1789403300.797922:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11256:x1876325038073728:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 458us (787us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789403300.797929:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:3.0:1789403300.801066:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403300.805135:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038073856 00000100:00100000:2.0:1789403300.805159:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038073856 00000100:00100000:2.0:1789403300.805252:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:2.0:1789403300.805264:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11256:x1876325038073856:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1789403300.805361:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805401:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805417:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805429:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805455:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805462:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805553:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805563:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805570:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403300.805634:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805649:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805656:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805664:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805670:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403300.805676:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805685:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805706:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403300.805709:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403300.805717:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805723:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7610d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805739:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805746:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805751:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805757:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403300.805760:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805765:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805772:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:2.0:1789403300.805775:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403300.805778:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805782:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7610dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805801:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805808:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805815:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805819:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403300.805822:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805827:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805835:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403300.805837:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403300.805840:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403300.805846:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7610e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403300.805961:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11256:x1876325038073856:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 698us (4910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403300.805970:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:0.0:1789403300.811755:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.811869:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038074112 00000100:00100000:1.0:1789403300.811884:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038074112 00000100:00100000:1.0:1789403300.811969:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403300.811998:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11256:x1876325038074112:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403300.812305:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:11256:x1876325038074112:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 310us (564us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789403300.812313:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1789403300.878536:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403300.878890:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038074368 00000100:00100000:0.0:1789403300.878904:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038074368 00000100:00100000:0.0:1789403300.878990:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:0.0:1789403300.879003:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:11259:x1876325038074368:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403300.879034:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403300.879060:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7610ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287c3 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.879162:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.879179:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.879214:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.879227:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.879235:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.879241:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.882116:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7610ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.882150:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7610ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.882164:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7610ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789403300.882177:0:6499:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:0.0:1789403300.908590:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00020000:0.0:1789403300.908631:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:0.0:1789403300.908804:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908818:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908826:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908844:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403300.908850:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908859:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908881:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403300.908885:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403300.908891:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908897:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0200/0x5fb08b1e5b7610f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908916:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908923:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908929:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.908933:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403300.908936:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.912174:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.912233:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:0.0:1789403300.912238:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403300.912245:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.912254:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1c00/0x5fb08b1e5b7610f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.912550:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7610ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287c3 expref: 58 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.912569:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7610ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287c3 expref: 57 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.912578:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403300.912581:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403300.912583:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9c00, rc 0) 00000100:00100000:0.0:1789403300.912682:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:11259:x1876325038074368:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 33680us (34160us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789403300.912693:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:3.0:1789403300.934277:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403300.934431:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038074496 00000100:00100000:0.0:1789403300.934447:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038074496 00000100:00100000:0.0:1789403300.934544:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1789403300.934557:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:2389:x1876325038074496:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403300.934582:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403300.934617:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7610ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287c3 expref: 57 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403300.934669:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403300.934676:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403300.934771:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:2389:x1876325038074496:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 215us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403300.934778:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1789403300.959517:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403300.959621:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038074624 00000100:00100000:3.0:1789403300.959637:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038074624 00000100:00100000:3.0:1789403300.959709:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:3.0:1789403300.959723:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:11259:x1876325038074624:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1789403300.959813:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959837:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959851:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959894:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959901:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959909:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959934:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403300.959950:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959960:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959975:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403300.959979:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403300.959985:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403300.959992:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76110d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403300.960101:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:11259:x1876325038074624:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 382us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403300.960110:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:3.0:1789403300.964321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403300.964567:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038074880 00000100:00100000:1.0:1789403300.964583:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038074880 00000100:00100000:1.0:1789403300.964666:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1789403300.964681:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:11259:x1876325038074880:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403300.965004:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:11259:x1876325038074880:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 326us (703us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789403300.965013:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1789403301.256528:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403301.256659:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038075136 00000100:00100000:2.0:1789403301.256689:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038075136 00000100:00100000:2.0:1789403301.256767:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:2.0:1789403301.256779:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:11277:x1876325038075136:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:2.0:1789403301.256811:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403301.256838:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761114 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287ca expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.256986:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76111b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.257006:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76111b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.257022:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76111b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403301.257035:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00020000:2.0:1789403301.257044:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602069505 00010000:00010000:2.0:1789403301.257200:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761114 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ca expref: 60 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.257224:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76111b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ca expref: 59 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.257235:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403301.257239:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789403301.257244:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7600, rc 0) 00000100:00100000:2.0:1789403301.257339:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:11277:x1876325038075136:12345-192.168.203.43@tcp:101:cat.0 Request processed in 562us (826us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789403301.257347:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00000001:00080000:0.0:1789403301.267870:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:0.0:1789403301.267910:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1789403301.268011:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789403301.268069:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268085:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268093:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268100:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.268106:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268135:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268156:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a141a01b00) 00010000:00010000:3.0:1789403301.268159:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.268166:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268174:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b760ef9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268201:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268208:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268214:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268219:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.268222:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268228:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268236:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403301.268238:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.268242:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268257:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b760f00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268274:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268280:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268287:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268292:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.268295:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268302:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268309:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:3.0:1789403301.268311:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.268313:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268319:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b760f3f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268333:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268338:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268350:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268355:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.268357:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268364:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268372:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403301.268374:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.268377:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268383:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761049 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268428:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268434:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268440:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268445:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.268449:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268464:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268473:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403301.268476:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.268478:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268484:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76106c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268495:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268501:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268507:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268512:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.268515:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268521:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268528:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403301.268530:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.268533:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.268549:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7610b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403301.275748:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403301.275778:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050742656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789403301.275870:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403301.275970:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050742656 00000100:00100000:2.0:1789403301.275979:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050742656 00000100:00100000:2.0:1789403301.276048:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403301.276057:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050742656:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1789403301.276285:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789403301.278794:0:8417:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789403301.278855:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa820a2, atime: 0x6aa820a3, ctime: 0x6aa820a2, blocks: 0x8 00010000:00010000:2.0:1789403301.278866:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.278885:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1789403301.278890:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403301.278897:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.278918:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.278929:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.278947:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403301.278971:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403301.279231:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403301.279241:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.279249:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403301.279255:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.279266:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.279290:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.279299:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b761129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.279336:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403301.279338:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403301.279340:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403301.280806:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3628:x1876325050742656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4737us (4925us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789403301.280823:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:0.0:1789403301.281001:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a1436576c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789403301.281007:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a249538100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a143657900 00000020:00080000:0.0:1789403301.281011:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a249538900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a274d39000 00000020:00080000:1.0:1789403301.281123:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789403301.281332:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:3.0:1789403301.282054:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a250e2a680/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789403301.282067:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050742656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789403301.299891:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403301.299983:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038075264 00000100:00100000:0.0:1789403301.299997:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038075264 00000100:00100000:0.0:1789403301.300070:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1789403301.300083:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11278:x1876325038075264:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403301.300114:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403301.300142:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b761130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287d1 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403301.300228:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761137 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403301.300247:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403301.300282:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403301.300340:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789403301.300345:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403301.300368:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403301.300425:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b761130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d1 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403301.300447:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d1 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403301.300457:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403301.300460:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403301.300465:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9a00, rc 0) 00000100:00100000:0.0:1789403301.300549:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11278:x1876325038075264:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 469us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403301.300557:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:1.0:1789403301.306979:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403301.307170:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038075648 00000100:00100000:0.0:1789403301.307183:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038075648 00000100:00100000:0.0:1789403301.307253:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1789403301.307266:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11278:x1876325038075648:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403301.307875:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11278:x1876325038075648:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 607us (906us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789403301.307885:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403301.317238:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403301.317335:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038075776 00000100:00100000:3.0:1789403301.317350:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038075776 00000100:00100000:3.0:1789403301.317474:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403301.317487:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11278:x1876325038075776:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:3.0:1789403301.317506:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789403301.317538:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b7610c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287b5 expref: 15 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.317565:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76111b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ca expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.317578:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b760fbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12876f expref: 13 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.317590:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403301.317597:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403301.317688:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:11278:x1876325038075776:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 203us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403301.317695:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403301.323534:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403301.323822:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038075904 00000100:00100000:1.0:1789403301.323835:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038075904 00000100:00100000:1.0:1789403301.323908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:1.0:1789403301.323921:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:11278:x1876325038075904:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:1.0:1789403301.324246:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.324267:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403301.324280:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403301.324614:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403301.324764:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789403301.324861:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789403301.324993:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:11278:x1876325038075904:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 1072us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403301.325018:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:2.0:1789403301.360048:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403301.360296:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038076032 00000100:00100000:0.0:1789403301.360310:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038076032 00000100:00100000:0.0:1789403301.360423:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:0.0:1789403301.360436:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:11280:x1876325038076032:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403301.360629:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403301.360732:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761145 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287d8 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360820:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360838:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360852:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360867:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360873:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360879:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.360995:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361005:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361012:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403301.361068:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789403301.361073:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403301.361111:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361126:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361135:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361142:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361149:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361155:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.361160:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361337:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361352:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403301.361356:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.361362:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361368:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76114c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361382:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361917:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361946:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361952:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403301.361956:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361962:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361971:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a2609b8200) 00010000:00010000:3.0:1789403301.361974:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403301.361977:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.361982:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761153 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.362036:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761145 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 14 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.362052:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 13 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403301.362059:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403301.362061:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403301.362064:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184e00, rc 0) 00000100:00100000:3.0:1789403301.362148:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11280:x1876325038076032:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1714us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403301.362173:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00010000:00010000:1.0:1789403301.365006:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403302.101680:0:14191:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789403302.101690:0:14191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789403302.101714:0:14191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789403302.101721:0:14191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789403302.321577:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789403302.321587:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789403302.321631:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789403302.321653:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789403302.321801:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050742784:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789403302.321899:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403302.324525:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050742784:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789403302.328075:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.328219:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038076160 00000100:00100000:3.0:1789403302.328229:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038076160 00000100:00100000:3.0:1789403302.328306:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:3.0:1789403302.328319:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11292:x1876325038076160:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789403302.328349:0:9061:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789403302.328502:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11292:x1876325038076160:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 186us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403302.328510:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00080000:2.0:1789403302.328969:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403302.333049:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403302.333126:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038076288 00000100:00100000:0.0:1789403302.333136:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038076288 00000100:00100000:0.0:1789403302.333221:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1789403302.333231:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11292:x1876325038076288:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789403302.333316:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333332:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333342:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333471:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333481:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333489:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333516:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333523:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333527:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403302.333581:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789403302.333585:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403302.333607:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333616:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333621:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333625:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333629:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403302.333632:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333638:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333649:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:0.0:1789403302.333652:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403302.333657:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333663:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761161 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333675:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333691:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333841:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333845:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403302.333847:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333852:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333857:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff90a27c1d4700) 00010000:00010000:0.0:1789403302.333859:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403302.333861:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333865:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761168 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333877:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333880:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333884:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333887:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403302.333894:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333898:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333903:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403302.333905:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403302.333906:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.333910:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b76116f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403302.333994:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11292:x1876325038076288:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 760us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403302.334003:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1789403302.336003:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.336142:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038076544 00000100:00100000:3.0:1789403302.336200:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038076544 00000100:00100000:3.0:1789403302.336250:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:3.0:1789403302.336318:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11292:x1876325038076544:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403302.336333:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403302.336359:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761176 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287df expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.336488:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.336499:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.336507:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403302.336514:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00020000:3.0:1789403302.336519:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:3.0:1789403302.346257:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.346274:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.346281:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.346286:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403302.346291:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.346298:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.346314:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403302.346317:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403302.346690:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.346699:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76117d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.347823:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761176 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287df expref: 15 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.347841:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:2.0:1789403302.347844:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403302.347848:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761176 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287df expref: 15 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.347862:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185800, rc 0) 00000100:00100000:2.0:1789403302.347936:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038076544:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 11612us (11930us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789403302.347945:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:3.0:1789403302.352950:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.353023:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038076672 00000100:00100000:1.0:1789403302.353032:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038076672 00000100:00100000:1.0:1789403302.353086:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:1.0:1789403302.353096:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038076672:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789403302.353223:0:6500:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789403302.353346:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038076672:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 251us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.353354:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:1.0:1789403302.380157:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403302.380252:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038076928 00000100:00100000:0.0:1789403302.380262:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038076928 00000100:00100000:0.0:1789403302.380315:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:0.0:1789403302.380325:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038076928:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403302.380345:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403302.380348:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789403302.380383:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761137 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d1 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.380451:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403302.380457:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403302.380485:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76118b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287e6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789403302.382314:0:6501:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789403302.386092:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b761192 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.386115:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b761192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.386126:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b761192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403302.386153:0:6501:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:2.0:1789403302.386170:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:2.0:1789403302.386225:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76118b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287e6 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.386249:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b761192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287e6 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.386257:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a141a01f00) 00010000:00010000:2.0:1789403302.386261:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403302.386264:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7c00, rc 0) 00000100:00100000:2.0:1789403302.386372:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038076928:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6047us (6223us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789403302.386381:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00010000:00010000:0.0:1789403302.386562:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403302.416030:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.416208:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038077184 00000100:00100000:2.0:1789403302.416219:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038077184 00000100:00100000:2.0:1789403302.416279:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1789403302.416290:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038077184:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.416344:0:13788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403302.416371:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b761192 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287e6 expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416428:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a141a01f00) 00010000:00010000:2.0:1789403302.416441:0:13788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403302.416464:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416498:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416508:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416523:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416529:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416536:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416583:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416590:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416597:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416603:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403302.416607:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416614:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416622:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403302.416631:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403302.416649:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416656:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416666:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416672:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416678:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416684:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403302.416686:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416915:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.416924:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd83bfcf8 (ffff90a141a01900) 00010000:00010000:2.0:1789403302.417179:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403302.417184:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.417192:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd83bfcf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.417493:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038077184:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1203us (1470us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789403302.417509:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:3.0:1789403302.421009:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.421105:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038077312 00000100:00100000:1.0:1789403302.421176:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038077312 00000100:00100000:1.0:1789403302.421271:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1789403302.421282:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038077312:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403302.421299:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403302.421319:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7611ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287ed expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.421352:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.421367:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.421378:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.421664:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7611ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.421681:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.421689:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:1.0:1789403302.421699:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403302.421703:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063200, rc 0) 00000100:00100000:1.0:1789403302.421943:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038077312:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 661us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.421951:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:1.0:1789403302.426188:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.426272:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038077568 00000100:00100000:2.0:1789403302.426283:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038077568 00000100:00100000:2.0:1789403302.426380:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:2.0:1789403302.426436:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038077568:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.426549:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.426567:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.426578:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403302.426990:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789403302.427001:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348425611585ns, next at 349425608464ns, rc = 0 00000004:00010000:2.0:1789403302.427047:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000218a013d reply state 000000009d6fa8d5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.427061:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.427070:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:2.0:1789403302.427073:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789403302.427077:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403302.427361:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:11292:x1876325038077568:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 971us (1244us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789403302.427370:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:3.0:1789403302.430475:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.430887:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038077696 00000100:00100000:2.0:1789403302.430913:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038077696 00000100:00100000:2.0:1789403302.431078:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:2.0:1789403302.431089:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:11292:x1876325038077696:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.431120:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403302.431141:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287f4 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.431197:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.431211:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.431230:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:2.0:1789403302.431234:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403302.431238:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6200, rc 0) 00000100:00100000:2.0:1789403302.431337:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:11292:x1876325038077696:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 251us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.431345:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1789403302.437436:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.437798:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038077824 00000100:00100000:2.0:1789403302.437809:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038077824 00000100:00100000:2.0:1789403302.437895:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1789403302.437903:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1876325038077824:12345-192.168.203.43@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789403302.437950:0:8563:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1789403302.437982:0:8563:0:(genops.c:1384:class_connect()) connect: client fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4, cookie 0x5fb08b1e5b7611ca 00002000:00100000:2.0:1789403302.437995:0:8563:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4/ffff90a2488fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789403302.438029:0:8563:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789403302.438103:0:8563:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789403302.438143:0:8563:0:(import.c:65:import_set_state_nolock()) ffff90a256651800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403302.438212:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2386:x1876325038077824:12345-192.168.203.43@tcp:8:lhsmtool_posix.0 Request processed in 308us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.438219:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1789403302.441461:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.442596:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038077952 00000100:00100000:1.0:1789403302.442780:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038077952 00000100:00100000:1.0:1789403302.442894:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:1.0:1789403302.442904:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:0:x1876325038077952:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789403302.443277:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789403302.453959:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1789403302.453979:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000100:00100000:1.0:1789403302.457946:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:0:x1876325038077952:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 15017us (16468us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789403302.457965:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:0.0:1789403302.461946:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.462181:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038078208 00000100:00100000:1.0:1789403302.462195:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038078208 00000100:00100000:1.0:1789403302.462325:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403302.462345:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:11292:x1876325038078208:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789403302.462974:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11292:x1876325038078208:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 628us (1047us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789403302.463003:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403302.469586:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.469795:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038078464 00000100:00100000:1.0:1789403302.469810:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038078464 00000100:00100000:1.0:1789403302.469892:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:1.0:1789403302.469905:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11292:x1876325038078464:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789403302.470094:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11292:x1876325038078464:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 192us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.470102:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:0.0:1789403302.475321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.476867:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038078592 00000100:00100000:2.0:1789403302.476885:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038078592 00000100:00100000:2.0:1789403302.477050:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:2.0:1789403302.477064:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11292:x1876325038078592:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.477093:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403302.477228:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b7611d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1287fb expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.477321:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7611d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.477416:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7611d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.477434:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7611d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403302.477501:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403302.477525:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7611d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.477557:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b7611d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287fb expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.477600:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7611d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287fb expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.477609:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:2.0:1789403302.477613:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789403302.477617:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6800, rc 0) 00000100:00100000:2.0:1789403302.477833:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11292:x1876325038078592:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 772us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.477841:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:3.0:1789403302.482748:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.485496:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038078720 00000100:00100000:2.0:1789403302.485517:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038078720 00000100:00100000:2.0:1789403302.485668:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1789403302.485683:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038078720:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.485707:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403302.485735:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128802 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403302.485770:0:8563:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa820a6, blocks: 0x0 00010000:00010000:2.0:1789403302.485795:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789403302.485800:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403302.485811:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 6 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.485832:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 6 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.485869:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7c00, rc 0) 00000100:00100000:2.0:1789403302.485967:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038078720:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 287us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.485975:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1789403302.489025:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.493651:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038078976 00000100:00100000:1.0:1789403302.493675:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038078976 00000100:00100000:1.0:1789403302.493770:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:1.0:1789403302.493784:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11292:x1876325038078976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789403302.493946:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11292:x1876325038078976:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 164us (4932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.493953:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:1.0:1789403302.499317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.499430:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038079104 00000100:00100000:3.0:1789403302.499444:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038079104 00000100:00100000:3.0:1789403302.499516:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:3.0:1789403302.499529:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:11292:x1876325038079104:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403302.499553:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403302.499582:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128809 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.499621:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.499630:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403302.499636:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403302.499642:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.499707:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.499723:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403302.499739:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8415:1876325050742912:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403302.499860:0:8415:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403302.505855:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8415:1876325050742912:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403302.505912:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.505950:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185a00, rc 0) 00000100:00100000:3.0:1789403302.506036:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11292:x1876325038079104:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6510us (6732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403302.506047:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1789403302.506951:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.507062:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038079232 00000100:00100000:3.0:1789403302.507072:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038079232 00010000:00010000:3.0:1789403302.507116:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403302.507159:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1789403302.507170:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038079232:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403302.507200:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403302.507228:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.507244:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.507276:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c518968/0x5fb08b1e5b7611df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128802 expref: 7 pid: 8563 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.507296:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403302.507301:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403302.507311:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.507322:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.507372:0:7451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 6 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403302.507681:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7451:1876325050743040:192.168.203.43@tcp:105: 00000100:00100000:3.0:1789403302.507775:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403302.511228:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7451:1876325050743040:192.168.203.43@tcp:105: 00010000:00010000:3.0:1789403302.511266:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403302.511369:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038079232:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 4199us (4420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403302.511383:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1789403302.515899:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.516216:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038079360 00000100:00100000:3.0:1789403302.516231:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038079360 00002000:00100000:3.0:1789403302.516298:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90a1440ac000 x1876325038079360/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:463/0 lens 504/0 e 0 to 0 dl 1789403313 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789403302.516311:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a1440ac000 with x1876325038079360 ext(0->8) 00002000:00010000:3.0:1789403302.516319:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a1440ac000 00000100:00100000:3.0:1789403302.516451:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403302.516464:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038079360:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789403302.518210:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038079360:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 1334us (1910us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789403302.518225:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00002000:00100000:3.0:1789403302.518237:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90a1440ac000 x1876325038079360/t4294967303(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:463/0 lens 504/448 e 0 to 0 dl 1789403313 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789403302.518248:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a1440ac000 with x1876325038079360 ext(0->8) 00002000:00010000:3.0:1789403302.518255:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a1440ac000 00000100:00100000:0.0:1789403302.524451:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.526417:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038079488 00000100:00100000:2.0:1789403302.526453:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038079488 00000100:00100000:2.0:1789403302.526556:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:2.0:1789403302.526569:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11292:x1876325038079488:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789403302.534152:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789403302.534178:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789403302.534209:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1789403302.534465:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038079488:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 7891us (10072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403302.534479:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00000020:00080000:2.0:1789403302.534890:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789403302.534905:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789403302.536043:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050743168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789403302.536137:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403302.537146:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050743168 00000100:00100000:0.0:1789403302.537162:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050743168 00000100:00100000:0.0:1789403302.537258:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403302.537270:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050743168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789403302.537490:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789403302.537494:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789403302 00002000:00010000:0.0:1789403302.537497:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789403302.537499:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789403302 -> 1789403302 00002000:00010000:0.0:1789403302.537518:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789403302.537607:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050743168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 340us (1469us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789403302.537615:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1789403302.537674:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a2488b1180/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789403302.537681:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050743168:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789403302.538025:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.538039:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.538047:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.538066:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403302.538072:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.538140:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789403302.538325:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789403302.540002:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:3.0:1789403302.540012:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789403302.540022:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.540033:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7611bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403302.540272:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.540407:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038079616 00000100:00100000:1.0:1789403302.540421:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038079616 00000100:00100000:1.0:1789403302.540487:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1789403302.540500:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038079616:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789403302.546585:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1789403302.546606:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789403302.551623:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038079616:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 11107us (11337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.551770:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1789403302.555217:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.555436:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038079872 00000100:00100000:2.0:1789403302.555451:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038079872 00000100:00100000:1.0:1789403302.555665:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:1.0:1789403302.555696:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038079872:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789403302.555771:0:13788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403302.555808:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7611d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287fb expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.555834:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:1.0:1789403302.555841:0:13788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403302.555881:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.555899:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.555912:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403302.556094:0:13788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd618a74 reply state 00000000f5758130 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.556109:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.556115:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:1.0:1789403302.556118:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403302.556121:0:13788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403302.556260:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038079872:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 567us (1057us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789403302.556268:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:0.0:1789403302.565330:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.565922:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038080000 00000100:00100000:2.0:1789403302.565945:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038080000 00000100:00100000:2.0:1789403302.566106:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:2.0:1789403302.566120:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038080000:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789403302.566335:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789403302.566339:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789403302 -> 1789403300 00002000:00010000:2.0:1789403302.566342:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789403299 00002000:00010000:2.0:1789403302.566345:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789403302 -> 1789403300 00002000:00010000:2.0:1789403302.566364:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789403302.566895:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038080000:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 776us (1576us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789403302.566906:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:0.0:1789403302.574287:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.578377:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038080256 00000100:00100000:2.0:1789403302.578472:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038080256 00000100:00100000:0.0:1789403302.578780:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:0.0:1789403302.578794:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:11292:x1876325038080256:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789403302.578903:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.578951:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.578964:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.579025:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.579042:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 15 pid: 6500 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403302.579060:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050743296:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403302.579250:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403302.582683:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050743296:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403302.582741:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403302.582809:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.583115:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038080384 00000100:00100000:2.0:1789403302.583124:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038080384 00010000:00010000:2.0:1789403302.583173:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 16 pid: 6500 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.583218:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1789403302.583229:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:2390:x1876325038080384:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403302.583247:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403302.583255:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 16 pid: 6500 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.583269:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 16 pid: 6500 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.583310:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7611b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287ed expref: 16 pid: 6500 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.583485:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:2.0:1789403302.583493:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.583506:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.583679:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.583764:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403302.583834:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:2390:x1876325038080384:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 606us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.583843:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00010000:00010000:1.0:1789403302.586692:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586714:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586770:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586777:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586786:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586792:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403302.586798:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586807:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.586829:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:1.0:1789403302.586833:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789403302.586838:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.587658:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7611f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403302.588199:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038080256:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 9401us (13918us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789403302.588212:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:0.0:1789403302.593255:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.594082:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038080512 00000100:00100000:3.0:1789403302.594099:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038080512 00000100:00100000:2.0:1789403302.594538:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1789403302.594552:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038080512:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.594621:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.594653:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.594662:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403302.594668:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403302.594673:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.594719:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 7 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.594737:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 7 pid: 8415 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.594778:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8415:1876325050743424:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403302.594881:0:8415:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403302.599736:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.600132:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8415:1876325050743424:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403302.600169:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403302.601726:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038080640 00000100:00100000:1.0:1789403302.601742:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038080640 00010000:00010000:1.0:1789403302.601802:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 8 pid: 8415 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403302.601892:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1789403302.601904:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038080640:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403302.601923:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403302.601962:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 8 pid: 8415 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.601978:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 8 pid: 8415 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.602010:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7611e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128809 expref: 8 pid: 8415 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.602032:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789403302.602037:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789403302.602044:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.602076:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.602119:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403302.602209:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038080640:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 306us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.602216:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00010000:00010000:2.0:1789403302.602575:0:8415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602587:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602616:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602626:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602634:0:8415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602641:0:8415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403302.602647:0:8415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602669:0:8415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602682:0:8415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.602690:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d4df77/0x5fb08b1e5b7611fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.602767:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038080512:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 8217us (9688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.602775:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1789403302.605795:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.605992:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038080896 00000100:00100000:2.0:1789403302.606005:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038080896 00000100:00100000:2.0:1789403302.606079:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:2.0:1789403302.606092:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11292:x1876325038080896:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789403302.606202:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.606223:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 14 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.606234:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.606279:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 14 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.606313:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 14 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.606340:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050743552:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403302.606475:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403302.608860:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.608880:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050743552:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403302.608915:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403302.608981:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081024 00000100:00100000:0.0:1789403302.608990:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081024 00010000:00010000:0.0:1789403302.609031:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 15 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403302.609078:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1789403302.609089:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a605450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:2389:x1876325038081024:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403302.609106:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403302.609114:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 15 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.609126:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 15 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.609152:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761042 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128792 expref: 15 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.609169:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:0.0:1789403302.609175:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.609186:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.609214:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.609241:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403302.609316:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a605450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:2389:x1876325038081024:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 227us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403302.609323:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00010000:00010000:2.0:1789403302.609802:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.609811:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.610042:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.610056:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.610064:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.610097:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.610112:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 14 pid: 6501 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.610139:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050743680:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403302.610215:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403302.620755:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050743680:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403302.620796:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403302.628484:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403302.628664:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081152 00000100:00100000:3.0:1789403302.628679:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081152 00010000:00010000:3.0:1789403302.628737:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 15 pid: 6501 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403302.628779:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1789403302.628791:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:2390:x1876325038081152:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403302.628810:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403302.628819:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 15 pid: 6501 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.628859:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 15 pid: 6501 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.628886:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7611c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287f4 expref: 15 pid: 6501 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.628907:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:3.0:1789403302.628914:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.628936:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.628946:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.628986:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403302.629114:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.629124:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789403302.629270:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789403302.629450:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789403302.629492:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789403302.629603:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050743808:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789403302.629689:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403302.629731:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643000 going to sleep for 11 seconds 00000100:00100000:2.0:1789403302.631659:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050743808 00000100:00100000:2.0:1789403302.631679:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050743808 00000100:00100000:2.0:1789403302.631763:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789403302.631774:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050743808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789403302.631951:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050743808:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403302.631958:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789403302.632017:0:6499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789403302.632025:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a2488b1180, transno 4294967304 00000100:00100000:2.0:1789403302.632070:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050743808:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789403302.632263:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789403302.632360:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050743936:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789403302.632432:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403302.632458:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2616439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403302.632476:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050743936 00000100:00100000:2.0:1789403302.632481:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050743936 00000100:00100000:2.0:1789403302.632508:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789403302.632514:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050743936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789403302.632626:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6499:x1876325050743936:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (194us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789403302.632634:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789403302.632669:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050743936:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789403302.632711:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632722:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632731:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632738:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403302.632743:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632752:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632783:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:2.0:1789403302.632786:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403302.632794:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632801:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761209 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632838:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632845:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632851:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632856:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403302.632858:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632865:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632873:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:2.0:1789403302.632875:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403302.632878:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632884:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76113e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632935:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632951:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 18 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632961:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.632991:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 18 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.633008:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 18 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403302.633021:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050744064:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403302.634006:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038081152:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5208us (5529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403302.634020:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:3.0:1789403302.640185:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403302.643990:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403302.644092:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081280 00000100:00100000:1.0:1789403302.644105:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081280 00010000:00010000:1.0:1789403302.644157:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 18 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403302.644205:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:1.0:1789403302.644216:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038081280:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403302.644239:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403302.644247:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 18 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.644262:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 18 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.644290:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:1.0:1789403302.644296:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.644323:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.644341:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403302.644365:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403302.644664:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038081280:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 449us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403302.644673:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00010000:00010000:3.0:1789403302.648580:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b76115a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1287d8 expref: 17 pid: 13788 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403302.648616:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050744064:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403302.648670:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648707:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648713:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648731:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648738:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648746:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648753:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403302.648758:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648767:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648787:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403302.648791:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403302.648796:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648803:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761210 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648815:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648827:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648834:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648839:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403302.648842:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648848:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648857:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a141a01500) 00010000:00010000:3.0:1789403302.648860:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403302.648862:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.648868:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761202 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403302.649133:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11292:x1876325038080896:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 43042us (43349us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789403302.649145:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000020:00080000:3.0:1789403302.649153:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789403302.649463:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403302.649470:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403302.649506:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789403302.649513:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403302.653061:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403302.653169:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081536 00000100:00100000:2.0:1789403302.653182:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081536 00000100:00100000:2.0:1789403302.653250:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1789403302.653262:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11292:x1876325038081536:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789403302.653861:0:6503:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789403302.653902:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789403302.653955:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.653991:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.654007:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.654017:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.654024:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.654031:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403302.654144:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789403302.654258:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:11292:x1876325038081536:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 995us (1207us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789403302.654267:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000020:00080000:2.0:1789403302.654274:0:6503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789403302.663051:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403302.663070:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.663085:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403302.663119:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.663131:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.663155:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:3.0:1789403302.663159:0:8431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789403302.663164:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403302.663171:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761217 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403302.663480:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403302.663483:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403302.663485:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403303.415736:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403303.502654:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502707:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502741:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502778:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502808:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502829:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502852:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403303.502883:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081664 00000100:00100000:0.0:1789403303.502896:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081664 00000100:00100000:3.0:1789403303.502967:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081792 00000100:00100000:0.0:1789403303.502968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 380 00000100:00100000:3.0:1789403303.502971:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081792 00000100:00100000:0.0:1789403303.502979:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2390:x1876325038081664:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403303.503009:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038082304 00000100:00100000:3.0:1789403303.503011:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038082304 00000100:00100000:3.0:1789403303.503031:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038081920 00000100:00100000:3.0:1789403303.503034:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038081920 00000100:00100000:3.0:1789403303.503045:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038082432 00000100:00100000:3.0:1789403303.503047:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038082432 00000100:00100000:3.0:1789403303.503061:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 282 00000100:00100000:0.0:1789403303.503068:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2390:x1876325038081664:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403303.503069:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038081792:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403303.503075:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 380 00000100:00100000:3.0:1789403303.503105:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038081792:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403303.503111:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 282 00000100:00100000:0.0:1789403303.503116:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 283 00000100:00100000:0.0:1789403303.503138:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038082304:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403303.503174:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038082048 00000100:00100000:0.0:1789403303.503177:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038082304:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403303.503178:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038082048 00000100:00100000:1.0:1789403303.503213:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038082176 00000100:00100000:1.0:1789403303.503215:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038082176 00000100:00100000:1.0:1789403303.503239:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:1.0:1789403303.503246:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038082048:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403303.503277:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038082048:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403303.503284:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:1.0:1789403303.503296:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:1.0:1789403303.503301:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038082176:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403303.503324:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038082176:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403303.503330:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:3.0:1789403303.509811:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 284 00000100:00100000:3.0:1789403303.509854:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038081920:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403303.509973:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038081920:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 145us (7163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403303.509999:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 284 00000100:00100000:3.0:1789403303.510041:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 285 00000100:00100000:3.0:1789403303.510051:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038082432:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403303.510081:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038082432:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 32us (7228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403303.510087:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 285 00000100:00080000:3.0:1789403303.510270:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403303.510277:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403303.510280:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403303.515016:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 283 00000100:00100000:2.0:1789403303.667766:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050744192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403303.667855:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403303.667952:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050744192 00000100:00100000:2.0:1789403303.667960:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050744192 00000100:00100000:2.0:1789403303.668012:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403303.668020:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050744192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403303.668049:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1789403303.668093:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050744192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403303.668109:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403303.668163:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050744192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403303.679436:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403303.679469:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050744320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403303.679555:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403303.679659:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050744320 00000100:00100000:3.0:1789403303.679680:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050744320 00000100:00080000:2.0:1789403303.679758:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403303.679774:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789403303.679791:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050744320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403303.679821:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789403303.679890:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050744320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403303.679899:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789403303.680362:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050744320:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789403304.150560:0:14242:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403304.150573:0:14242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403304.150598:0:14242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789403304.150607:0:14242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789403304.179947:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050744448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403304.180050:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403304.180147:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050744448 00000100:00100000:3.0:1789403304.180158:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050744448 00000100:00100000:3.0:1789403304.180233:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789403304.180247:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050744448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403304.180295:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403304.180351:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050744448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403304.180372:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789403304.180472:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050744448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403304.376674:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403304.376734:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038082688 00000100:00100000:3.0:1789403304.376748:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038082688 00000100:00100000:3.0:1789403304.376907:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:3.0:1789403304.376932:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:11309:x1876325038082688:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403304.376960:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403304.377042:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76121e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128810 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.377206:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b761225 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.377222:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b761225 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.377234:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b761225 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403304.377244:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789403304.377365:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76121e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128810 expref: 21 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.377461:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b761225 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128810 expref: 20 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.377472:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403304.377636:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789403304.377656:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184e00, rc 0) 00000100:00100000:3.0:1789403304.377750:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11309:x1876325038082688:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 823us (1087us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789403304.377756:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00080000:2.0:1789403304.377817:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403304.381341:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.381660:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038082816 00000100:00100000:1.0:1789403304.381691:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038082816 00000100:00100000:1.0:1789403304.381765:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:1.0:1789403304.381778:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11309:x1876325038082816:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:1.0:1789403304.381883:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.381906:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.381932:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.381953:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.381961:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.381969:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382244:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382254:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382262:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403304.382324:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382356:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382365:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382373:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382380:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.382444:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382455:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382472:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403304.382849:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.382856:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382861:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761233 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382874:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382878:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382882:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382892:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.382895:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382901:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382920:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.382922:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.382926:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382931:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76123a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382949:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382955:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382961:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382966:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.382969:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382975:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.382995:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425ebb00) 00010000:00010000:1.0:1789403304.382997:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.383001:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.383018:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403304.383180:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11309:x1876325038082816:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1400us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403304.383190:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00010000:00010000:1.0:1789403304.436220:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403304.441457:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.442167:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038083072 00000100:00100000:1.0:1789403304.442184:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038083072 00000100:00100000:1.0:1789403304.442269:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:1.0:1789403304.442284:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:11312:x1876325038083072:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403304.442312:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403304.442337:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761248 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128817 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443158:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443181:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443196:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443239:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443247:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443255:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443569:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443580:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443588:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403304.443604:0:13788:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:1.0:1789403304.443611:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000004:00020000:1.0:1789403304.443701:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:1.0:1789403304.443797:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443805:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443812:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443818:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.443824:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443843:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443858:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403304.443862:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.443869:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443875:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76124f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443892:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443898:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443905:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443909:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.443922:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443929:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443936:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425ebb00) 00010000:00010000:1.0:1789403304.443939:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.443942:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.443959:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761256 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.444018:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761248 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.444036:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 22 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.444043:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.444045:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403304.444048:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062800, rc 0) 00000100:00100000:1.0:1789403304.444479:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11312:x1876325038083072:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2197us (3035us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789403304.444490:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:2.0:1789403304.449222:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403304.449359:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038083200 00000100:00100000:3.0:1789403304.449373:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038083200 00000100:00100000:3.0:1789403304.449473:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:3.0:1789403304.449488:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11312:x1876325038083200:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1789403304.449582:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449616:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449638:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449684:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449693:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449700:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449707:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403304.449713:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449721:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449752:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:3.0:1789403304.449755:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403304.449762:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.449769:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76126b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403304.449858:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11312:x1876325038083200:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 374us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403304.449867:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:2.0:1789403304.452896:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403304.453007:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038083456 00000100:00100000:0.0:1789403304.453020:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038083456 00000100:00100000:0.0:1789403304.453181:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1789403304.453196:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11312:x1876325038083456:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1789403304.453702:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:11312:x1876325038083456:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 507us (817us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789403304.453712:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403304.528058:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.528453:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038083712 00000100:00100000:1.0:1789403304.528468:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038083712 00000100:00100000:1.0:1789403304.528546:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:1.0:1789403304.528560:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:10827:x1876325038083712:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403304.528609:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403304.528639:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761272 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12881e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.528784:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.528802:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.528829:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.528874:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.528890:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 24 pid: 13788 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403304.528908:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050744576:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403304.529064:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403304.533354:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050744576:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403304.533412:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403304.533833:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403304.536437:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038083840 00000100:00100000:3.0:1789403304.536461:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038083840 00010000:00010000:3.0:1789403304.536532:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 25 pid: 13788 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403304.536900:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1789403304.536928:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:2390:x1876325038083840:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403304.536953:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403304.536962:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 25 pid: 13788 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.536978:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 25 pid: 13788 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.537021:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76125d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128817 expref: 25 pid: 13788 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.537062:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:3.0:1789403304.537068:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.537078:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.537087:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.537127:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403304.537208:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:2390:x1876325038083840:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 297us (3376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403304.537216:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00010000:00010000:1.0:1789403304.538045:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.538058:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403304.538083:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000004:00020000:1.0:1789403304.538105:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789403304.538273:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761272 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.538818:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.538848:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.538852:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403304.538856:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:1.0:1789403304.538943:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:10827:x1876325038083712:12345-192.168.203.43@tcp:101:bash.0 Request processed in 10384us (10899us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789403304.538952:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:2.0:1789403304.549330:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.549574:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038083968 00000100:00100000:1.0:1789403304.549588:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038083968 00000100:00100000:1.0:1789403304.549658:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:1.0:1789403304.549671:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:10827:x1876325038083968:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403304.549705:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403304.549733:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761287 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128825 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.549773:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76128e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.549790:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76128e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.549803:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76128e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.549961:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128825 expref: 26 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.549981:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76128e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128825 expref: 25 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.549999:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.550015:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403304.550021:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063a00, rc 0) 00000100:00100000:1.0:1789403304.550096:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:10827:x1876325038083968:12345-192.168.203.43@tcp:101:bash.0 Request processed in 428us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403304.550103:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:3.0:1789403304.553849:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.554189:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038084224 00000100:00100000:1.0:1789403304.554204:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038084224 00000100:00100000:1.0:1789403304.554276:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:1.0:1789403304.554289:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:10827:x1876325038084224:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:1.0:1789403304.554634:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.554660:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.554674:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403304.554727:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789403304.554756:0:9061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7a8fa1d reply state 00000000df6db2d7 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.554771:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.554779:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.554782:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403304.554804:0:9061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789403304.554896:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789403304.555062:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:10827:x1876325038084224:12345-192.168.203.43@tcp:36:bash.0 Request processed in 774us (1226us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789403304.555071:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000020:00080000:1.0:1789403304.555077:0:9061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789403304.559526:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.559622:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038084352 00000100:00100000:1.0:1789403304.559635:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038084352 00000100:00100000:1.0:1789403304.559717:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:1.0:1789403304.559728:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:10827:x1876325038084352:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403304.559759:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403304.559785:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76129c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12882c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.559863:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76129c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12882c expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.559883:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76129c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12882c expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.559908:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.559923:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403304.559929:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063c00, rc 0) 00000100:00100000:1.0:1789403304.560011:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:10827:x1876325038084352:12345-192.168.203.43@tcp:101:bash.0 Request processed in 283us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403304.560019:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:3.0:1789403304.565957:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.566126:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038084480 00000100:00100000:1.0:1789403304.566140:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038084480 00000100:00100000:1.0:1789403304.567617:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1789403304.567654:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:10827:x1876325038084480:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403304.567682:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403304.567710:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128833 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403304.567743:0:8563:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa820a4, atime: 0x6aa820a3, ctime: 0x6aa820a4, blocks: 0x8 00010000:00010000:1.0:1789403304.567775:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789403304.567781:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403304.567790:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 7 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.567812:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 7 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.567827:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062200, rc 0) 00000100:00100000:1.0:1789403304.567977:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:10827:x1876325038084480:12345-192.168.203.43@tcp:101:bash.0 Request processed in 329us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403304.567984:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00080000:2.0:1789403304.570186:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403304.574528:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403304.575568:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038084608 00000100:00100000:0.0:1789403304.575584:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038084608 00002000:00010000:0.0:1789403304.575644:0:8420:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789403304.575651:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a2488b5880 with x1876325038084608 ext(0->18446744073709551615) 00002000:00010000:0.0:1789403304.575669:0:8420:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a2488b5880. 00000100:00100000:0.0:1789403304.575717:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:0.0:1789403304.575729:0:8420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2388:x1876325038084608:12345-192.168.203.43@tcp:10:bash.0 00002000:00010000:0.0:1789403304.576092:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789403304.576096:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789403300 -> 1789403304 00002000:00010000:0.0:1789403304.576099:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789403299 -> 1789403299 00002000:00010000:0.0:1789403304.576111:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789403300 -> 1789403304 00002000:00010000:0.0:1789403304.576113:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789403304.576201:0:8420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2388:x1876325038084608:12345-192.168.203.43@tcp:10:bash.0 Request processed in 473us (1687us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789403304.576219:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00002000:00010000:0.0:1789403304.576223:0:8420:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789403304.576226:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a2488b5880 with x1876325038084608 ext(0->18446744073709551615) 00002000:00010000:0.0:1789403304.576231:0:8420:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a2488b5880. 00000100:00100000:0.0:1789403304.686012:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.686202:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038084736 00000100:00100000:1.0:1789403304.686232:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038084736 00000100:00100000:0.0:1789403304.686861:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:0.0:1789403304.686877:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11326:x1876325038084736:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1789403304.686986:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687016:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687031:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687050:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687057:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687064:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687159:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687186:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687194:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403304.687492:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687508:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687516:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687524:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687532:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403304.687537:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687546:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687560:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403304.687564:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403304.687570:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687577:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7612aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687604:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687609:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687615:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687850:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403304.687853:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687860:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687868:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a243d8b300) 00010000:00010000:0.0:1789403304.687870:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403304.687873:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687878:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7612b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687896:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687902:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687907:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687930:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403304.687933:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687939:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687947:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:0.0:1789403304.687950:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403304.687953:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403304.687958:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b7612b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403304.689865:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11326:x1876325038084736:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1331us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403304.689883:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:3.0:1789403304.748563:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403304.754181:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038084992 00000100:00100000:0.0:1789403304.754206:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038084992 00000100:00100000:1.0:1789403304.754602:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:1.0:1789403304.754617:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11329:x1876325038084992:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403304.754645:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403304.754674:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7612bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12883a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.754803:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.754822:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.754837:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.754854:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.754862:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.754868:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756169:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7612d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756191:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7612d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756202:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7612d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403304.756211:0:6499:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:1.0:1789403304.756222:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00020000:1.0:1789403304.756435:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:1.0:1789403304.756546:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756567:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756575:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756582:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.756587:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756596:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756610:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403304.756613:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.756618:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756625:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b7612c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756641:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756647:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756652:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756657:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403304.756665:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756671:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756678:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:1.0:1789403304.756680:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403304.756683:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756689:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7612cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756750:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7612bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12883a expref: 33 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756767:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7612d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12883a expref: 32 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403304.756774:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403304.756776:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789403304.756779:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062800, rc 0) 00000100:00100000:1.0:1789403304.756860:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11329:x1876325038084992:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2245us (8311us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789403304.756868:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:3.0:1789403304.761976:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403304.762465:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038085120 00000100:00100000:2.0:1789403304.762479:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038085120 00000100:00100000:2.0:1789403304.762566:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:2.0:1789403304.762580:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11329:x1876325038085120:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1789403304.764368:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.764417:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 32 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.764452:0:13788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.764579:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 32 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.764599:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 32 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403304.764619:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13788:1876325050744704:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403304.764966:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403304.770728:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13788:1876325050744704:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403304.770770:0:13788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403304.774904:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403304.775448:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038085376 00000100:00100000:1.0:1789403304.775462:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038085376 00000100:00100000:1.0:1789403304.775523:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1789403304.775536:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:6160:x1876325038085376:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789403304.778841:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:6160:x1876325038085376:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 3291us (3934us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789403304.778856:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1789403304.787962:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403304.794728:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038085504 00000100:00100000:3.0:1789403304.794752:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038085504 00010000:00010000:3.0:1789403304.794824:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 34 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403304.794883:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1789403304.794895:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:2389:x1876325038085504:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403304.794945:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403304.794954:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 34 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.794970:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 34 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.794997:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761279 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12881e expref: 34 pid: 6500 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.796181:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:3.0:1789403304.796189:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.796214:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.796224:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.796531:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403304.796821:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:2389:x1876325038085504:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1922us (8867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403304.796833:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00010000:00010000:2.0:1789403304.796973:0:13788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.796983:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797041:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797049:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797057:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797079:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403304.797084:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797093:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797108:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:2.0:1789403304.797111:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403304.797116:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403304.797122:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7612e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403304.797176:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11329:x1876325038085120:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 34600us (35215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403304.797185:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:3.0:1789403304.810526:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403304.814472:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038085760 00000100:00100000:0.0:1789403304.814496:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038085760 00000100:00100000:0.0:1789403304.814585:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1789403304.814600:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:11329:x1876325038085760:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1789403304.814946:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:11329:x1876325038085760:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 349us (4432us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789403304.814954:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1789403304.930546:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403304.930873:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038086016 00000100:00100000:3.0:1789403304.930888:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038086016 00000100:00100000:3.0:1789403304.930985:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:3.0:1789403304.930999:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:11340:x1876325038086016:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1789403304.931041:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403304.931068:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7612e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128841 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931164:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931182:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931198:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931214:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931222:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931229:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931385:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7612fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931428:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7612fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.931435:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7612fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403304.931442:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:3.0:1789403304.956492:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00000004:00020000:3.0:1789403304.956531:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023255553 00010000:00010000:3.0:1789403304.956683:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957371:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957381:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957420:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403304.957427:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957438:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957458:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403304.957461:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403304.957466:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957472:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7612f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957492:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957498:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957503:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957527:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403304.957530:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957536:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957545:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1434a9e00) 00010000:00010000:3.0:1789403304.957548:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403304.957551:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.957557:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7612f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.958655:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7612e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128841 expref: 36 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.958680:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7612fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128841 expref: 35 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403304.958690:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:3.0:1789403304.958693:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403304.958906:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184800, rc 0) 00000100:00100000:3.0:1789403304.959016:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11340:x1876325038086016:12345-192.168.203.43@tcp:101:cat.0 Request processed in 28018us (28481us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789403304.959026:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:2.0:1789403304.998024:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403304.998677:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038086272 00000100:00100000:0.0:1789403304.998692:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038086272 00000100:00100000:0.0:1789403304.998772:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1789403304.998786:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11340:x1876325038086272:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:0.0:1789403304.999209:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:11340:x1876325038086272:12345-192.168.203.43@tcp:35:cat.0 Request processed in 424us (1207us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789403304.999219:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1789403305.032364:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403305.032532:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038086528 00000100:00100000:1.0:1789403305.032547:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038086528 00000100:00100000:1.0:1789403305.032646:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:1.0:1789403305.032658:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:11341:x1876325038086528:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:1.0:1789403305.032757:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789403305.032800:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76129c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12882c expref: 36 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032830:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7612fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128841 expref: 35 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032845:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7612d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12883a expref: 34 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032858:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b76128e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128825 expref: 33 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032871:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403305.032879:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403305.032922:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032939:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032962:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032981:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032988:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.032995:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033101:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033111:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033118:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403305.033471:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1789403305.033484:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351032094047ns, next at 352032090313ns, rc = 0 00010000:00010000:1.0:1789403305.033541:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033550:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033559:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033579:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033586:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033592:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033624:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403305.033649:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033656:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033662:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033669:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403305.033674:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033682:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033692:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:1.0:1789403305.033695:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789403305.033699:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033714:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b76131a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033735:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033741:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033747:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033752:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403305.033755:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033760:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033767:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403305.033770:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403305.033773:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033779:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b76130c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403305.033788:0:6499:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4712dc0 reply state 00000000f6df8e3a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033800:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.033811:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:1.0:1789403305.033814:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403305.033817:0:6499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403305.033927:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:11341:x1876325038086528:12345-192.168.203.43@tcp:36:rm.0 Request processed in 1270us (1578us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789403305.033936:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 106 00010000:00010000:2.0:1789403305.034425:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403305.034438:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.034445:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403305.034449:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.034456:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.034476:0:8432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:2.0:1789403305.034478:0:8432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789403305.034481:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.034486:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761321 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.034498:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403305.034500:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403305.034501:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403305.100851:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403305.106974:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038086784 00000100:00100000:2.0:1789403305.106997:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038086784 00000100:00100000:2.0:1789403305.107097:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:2.0:1789403305.107110:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:11347:x1876325038086784:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403305.107145:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403305.107173:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761328 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128848 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.107717:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.107737:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.107751:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.107763:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.107789:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.107796:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789403305.108267:0:13788:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789403305.110437:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.110464:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.110477:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403305.110487:0:13788:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:2.0:1789403305.110502:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:2.0:1789403305.110531:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.110539:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.110547:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111465:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403305.111473:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111484:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111520:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403305.111524:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403305.111531:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111538:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b76132f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403305.111799:0:13788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e5a4490 reply state 000000003f6dde38 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111815:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111823:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:2.0:1789403305.111826:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403305.111830:0:13788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789403305.111886:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761328 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 37 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111902:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 36 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.111921:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403305.111924:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403305.111926:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7600, rc 0) 00000100:00100000:2.0:1789403305.112045:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:11347:x1876325038086784:12345-192.168.203.43@tcp:101:bash.0 Request processed in 4937us (11209us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789403305.112057:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 107 00000100:00100000:2.0:1789403305.147775:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.147881:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038086912 00000100:00100000:3.0:1789403305.147895:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038086912 00000100:00100000:3.0:1789403305.148001:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1789403305.148017:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038086912:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403305.148042:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403305.148068:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12884f expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789403305.148102:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403305.148126:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789403305.148132:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403305.148142:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 8 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.148164:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 8 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.148179:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185600, rc 0) 00000100:00100000:3.0:1789403305.148331:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038086912:12345-192.168.203.43@tcp:101:bash.0 Request processed in 320us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.148339:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00080000:2.0:1789403305.149518:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403305.160520:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403305.160634:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038087040 00000100:00100000:1.0:1789403305.160647:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038087040 00000100:00100000:1.0:1789403305.160724:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1789403305.160737:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:11347:x1876325038087040:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403305.160762:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403305.160786:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128856 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.160828:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.160838:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403305.160843:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403305.160849:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.160904:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.160929:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403305.160963:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8416:1876325050744832:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403305.161147:0:8416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403305.169002:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8416:1876325050744832:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403305.169048:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.169556:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063800, rc 0) 00000100:00100000:3.0:1789403305.169831:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:11347:x1876325038087040:12345-192.168.203.43@tcp:101:bash.0 Request processed in 9091us (9320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.169841:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1789403305.175683:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403305.175961:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038087168 00000100:00100000:1.0:1789403305.175975:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038087168 00010000:00010000:1.0:1789403305.176030:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403305.176085:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1789403305.176105:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038087168:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403305.176125:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403305.176156:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.176173:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.176216:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b76134b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12884f expref: 9 pid: 8417 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.176245:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403305.176251:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403305.176260:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.176293:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.176353:0:10319:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403305.176371:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10319:1876325050744960:192.168.203.43@tcp:105: 00000100:00100000:1.0:1789403305.176495:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403305.180876:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10319:1876325050744960:192.168.203.43@tcp:105: 00010000:00010000:3.0:1789403305.180921:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403305.180996:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038087168:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 4892us (5325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.181009:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:0.0:1789403305.183560:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403305.183718:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038087424 00000100:00100000:2.0:1789403305.183733:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038087424 00000100:00100000:2.0:1789403305.183813:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1789403305.183826:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:11347:x1876325038087424:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1789403305.185148:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11347:x1876325038087424:12345-192.168.203.43@tcp:35:bash.0 Request processed in 1319us (1598us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789403305.185161:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1789403305.202593:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403305.202625:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050745088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403305.202700:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403305.202790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050745088 00000100:00100000:3.0:1789403305.202804:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050745088 00000100:00100000:3.0:1789403305.202887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789403305.202902:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050745088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403305.202958:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789403305.203051:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050745088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.203059:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789403305.203119:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050745088:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1789403305.218783:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1789403305.218808:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1789403305.445347:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.445517:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038087552 00000100:00100000:3.0:1789403305.445529:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038087552 00000100:00100000:3.0:1789403305.445610:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:3.0:1789403305.445629:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:11363:x1876325038087552:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403305.445683:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403305.445708:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12885d expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.445789:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761360 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.445805:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.445818:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403305.446067:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789403305.446072:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403305.446161:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.446192:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12885d expref: 40 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.446216:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12885d expref: 39 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.446224:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403305.446228:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403305.446232:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185c00, rc 0) 00000100:00100000:3.0:1789403305.446810:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:11363:x1876325038087552:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1180us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.446819:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:1.0:1789403305.456597:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:1.0:1789403305.457734:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403305.462148:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038087808 00000100:00100000:0.0:1789403305.462173:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038087808 00000100:00100000:0.0:1789403305.462269:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:0.0:1789403305.462288:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:11363:x1876325038087808:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403305.462314:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403305.462341:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761367 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128864 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.462499:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76136e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.462518:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76136e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.462533:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76136e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403305.462545:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000004:00020000:0.0:1789403305.462554:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:0.0:1789403305.462797:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761367 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128864 expref: 42 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.463148:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76136e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128864 expref: 41 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.463161:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403305.463164:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403305.463168:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8c00, rc 0) 00000100:00100000:0.0:1789403305.463460:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+41:11363:x1876325038087808:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1178us (6876us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789403305.463469:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1789403305.468699:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403305.468849:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088064 00000100:00100000:1.0:1789403305.468863:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088064 00000100:00100000:1.0:1789403305.468962:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:1.0:1789403305.468975:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+41:11363:x1876325038088064:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403305.469006:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403305.469033:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76137c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12886b expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.469174:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761383 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.469192:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761383 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.469223:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761383 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403305.469241:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000004:00020000:1.0:1789403305.469252:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:1.0:1789403305.469418:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b76137c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12886b expref: 44 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.469442:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761383 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12886b expref: 43 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.469453:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403305.469456:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789403305.469461:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063c00, rc 0) 00000100:00100000:1.0:1789403305.469786:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:11363:x1876325038088064:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 812us (1100us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789403305.469794:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:2.0:1789403305.470080:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.470172:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088192 00000100:00100000:3.0:1789403305.470179:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088192 00000100:00100000:3.0:1789403305.470236:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403305.470245:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:2387:x1876325038088192:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403305.470256:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403305.470274:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76136e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128864 expref: 43 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.470289:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403305.470292:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403305.490799:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:2387:x1876325038088192:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 20534us (20698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.490820:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1789403305.514062:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.514233:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088320 00000100:00100000:3.0:1789403305.514246:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088320 00000100:00100000:3.0:1789403305.514318:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1789403305.514330:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038088320:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:3.0:1789403305.514421:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.514446:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.514457:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403305.514572:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403305.514579:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.514713:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.514731:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 6 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403305.514749:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876325050745216:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403305.514873:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403305.527015:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876325050745216:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403305.527064:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403305.534007:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.535039:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088448 00000100:00100000:3.0:1789403305.535057:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088448 00002000:00100000:3.0:1789403305.535145:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90a2488b1880 x1876325038088448/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:466/0 lens 504/0 e 0 to 0 dl 1789403316 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789403305.535158:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a2488b1880 with x1876325038088448 ext(0->8) 00010000:00010000:3.0:1789403305.535169:0:8422:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 7 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.535188:0:8422:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 7 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789403305.535197:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a2488b1880 00000100:00100000:3.0:1789403305.535261:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1789403305.535274:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038088448:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:3.0:1789403305.539548:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038088448:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 4268us (5548us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789403305.539562:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00002000:00100000:3.0:1789403305.539575:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90a2488b1880 x1876325038088448/t4294967303(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:466/0 lens 504/448 e 0 to 0 dl 1789403316 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789403305.539587:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a2488b1880 with x1876325038088448 ext(0->8) 00010000:00010000:3.0:1789403305.539599:0:8422:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.539621:0:8422:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789403305.539630:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a2488b1880 00000100:00100000:2.0:1789403305.550891:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.550986:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088576 00000100:00100000:3.0:1789403305.550996:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088576 00010000:00010000:3.0:1789403305.551037:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403305.551119:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:3.0:1789403305.551129:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a605850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038088576:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403305.551146:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789403305.551164:0:6487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789403305.551167:0:6487:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789403305 00002000:00010000:3.0:1789403305.551183:0:6487:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789403305 00002000:00010000:3.0:1789403305.551186:0:6487:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789403305 00002000:00010000:3.0:1789403305.551188:0:6487:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789403305.551195:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.551209:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.551241:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000818e40e/0x5fb08b1e5b761352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128856 expref: 9 pid: 8416 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.551258:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403305.551262:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403305.551269:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.551286:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.551349:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403305.551422:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a605850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038088576:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 293us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.551431:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00010000:00010000:2.0:1789403305.553328:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553349:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553379:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553400:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553409:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553435:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403305.553440:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553449:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553466:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.553474:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b761391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403305.553582:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038088320:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 39251us (39532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403305.553665:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1789403305.564237:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403305.564365:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088832 00000100:00100000:1.0:1789403305.564436:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088832 00000100:00100000:1.0:1789403305.564527:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1789403305.564539:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:11363:x1876325038088832:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:1.0:1789403305.564647:0:6502:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761383 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12886b expref: 42 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403305.564918:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789403305.564996:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789403305.565439:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789403305.565487:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.565507:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 46 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.565517:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.565560:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 46 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.565578:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 46 pid: 13788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403305.565595:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6502:1876325050745344:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403305.565730:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403305.571197:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.571328:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038088960 00000100:00100000:3.0:1789403305.571342:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038088960 00010000:00010000:3.0:1789403305.571439:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 47 pid: 13788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403305.571517:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:3.0:1789403305.571529:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:2389:x1876325038088960:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403305.571549:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403305.571558:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 47 pid: 13788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.571572:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 47 pid: 13788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.571610:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403305.571769:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.571782:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.571790:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.571818:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403305.572046:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b76133d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128848 expref: 47 pid: 13788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403305.572070:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6502:1876325050745344:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403305.572098:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.572109:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.572115:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403305.572275:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789403305.572444:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789403305.572573:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050745472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789403305.572661:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403305.572710:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789403305.572737:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050745472 00000100:00100000:1.0:1789403305.572744:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050745472 00000100:00100000:1.0:1789403305.572799:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789403305.572806:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050745472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789403305.572892:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050745472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403305.572900:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1789403305.572938:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403305.572963:0:6502:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1789403305.572969:0:6502:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1789403305.572986:0:6502:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a250e2a680, transno 4294967302 00000100:00100000:1.0:1789403305.573004:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050745472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789403305.573116:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789403305.573153:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050745600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789403305.573176:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403305.573196:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050745600 00000100:00100000:1.0:1789403305.573200:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050745600 00000100:00100000:1.0:1789403305.573218:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789403305.573224:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050745600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789403305.573311:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6502:x1876325050745600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (134us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789403305.573328:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789403305.573347:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403305.573365:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050745600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789403305.573429:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789403305.573460:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.573469:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.573477:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.573484:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403305.573489:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.573499:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.573515:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403305.573519:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789403305.573524:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403305.573531:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761398 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403305.573648:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789403305.573726:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789403305.573748:0:6502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351572358307ns, next at 352572355458ns, rc = 0 00000001:00080000:1.0:1789403305.573755:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789403305.573780:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403305.573783:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789403305.573790:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b761383 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12886b expref: 51 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403305.573952:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+50:2389:x1876325038088960:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 2422us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.573963:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1789403305.578813:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:11363:x1876325038088832:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 14045us (14360us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789403305.578834:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000020:00080000:1.0:1789403305.578845:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789403305.593418:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.600000:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038089088 00000100:00100000:3.0:1789403305.600023:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038089088 00000100:00100000:3.0:1789403305.600841:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:3.0:1789403305.600860:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:11363:x1876325038089088:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403305.600923:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403305.600957:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b76139f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128872 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.601035:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b76139f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128872 expref: 50 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.601052:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b76139f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128872 expref: 50 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.601074:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403305.601078:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403305.601082:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185000, rc 0) 00000100:00100000:3.0:1789403305.601191:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+50:11363:x1876325038089088:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 338us (7821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.601200:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 111 00000100:00100000:1.0:1789403305.618369:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403305.618576:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038089344 00000100:00100000:2.0:1789403305.618591:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038089344 00000100:00100000:2.0:1789403305.618690:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1789403305.618704:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+50:11363:x1876325038089344:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1789403305.619040:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+51:11363:x1876325038089344:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 339us (688us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789403305.619049:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1789403305.713716:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050745728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403305.713819:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403305.713955:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050745728 00000100:00100000:2.0:1789403305.713964:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050745728 00000100:00100000:2.0:1789403305.714039:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789403305.714050:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050745728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403305.714079:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789403305.714246:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403305.714441:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050745856:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714487:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.714516:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050746368:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714542:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.714562:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050746880:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714583:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.714605:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789403305.714611:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050745984:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714634:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.714653:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050746496:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714674:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.714692:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050747008:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714712:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.714763:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050745856 00000100:00100000:0.0:1789403305.714767:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050745856 00000100:00100000:0.0:1789403305.714799:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789403305.714805:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050745856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714852:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a261704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3628:x1876325050745856:12345-0@lo:400:kworker.0 Request processed in 46us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.714860:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789403305.714932:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050745856:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.714986:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746368 00000100:00100000:0.0:1789403305.714990:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746368 00000100:00100000:0.0:1789403305.715013:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746880 00000100:00100000:0.0:1789403305.715016:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746880 00000100:00100000:0.0:1789403305.715027:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050745984 00000100:00100000:0.0:1789403305.715029:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050745984 00000100:00100000:0.0:1789403305.715038:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746496 00000100:00100000:0.0:1789403305.715040:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746496 00000100:00100000:0.0:1789403305.715054:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050747008 00000100:00100000:0.0:1789403305.715056:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050747008 00000100:00100000:0.0:1789403305.715072:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789403305.715079:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050746368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715131:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050746368:12345-0@lo:400:kworker.0 Request processed in 52us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715136:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789403305.715150:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789403305.715156:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050746880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715181:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050746880:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715187:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789403305.715207:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789403305.715213:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050745984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715241:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050745984:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715246:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789403305.715257:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789403305.715262:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050746496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715287:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050746496:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715293:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789403305.715305:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789403305.715311:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050747008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715338:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050747008:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715343:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789403305.715372:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050745984:0@lo:400:kworker.0 00010000:00080000:0.0:1789403305.715385:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144048380 x1876325050746496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403305.715419:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050746496:0@lo:400:kworker.0 00010000:00080000:0.0:1789403305.715430:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144048a80 x1876325050747008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403305.715437:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050747008:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715446:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050746368:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715467:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050746880:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715524:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050746112:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715555:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.715575:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050746624:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715598:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.715621:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789403305.715627:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050746240:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715651:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.715670:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050746752:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715690:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403305.715712:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746112 00000100:00100000:0.0:1789403305.715717:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746112 00000100:00100000:0.0:1789403305.715742:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789403305.715748:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050746112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715779:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050746112:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715784:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789403305.715806:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050746112:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715846:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746240 00000100:00100000:0.0:1789403305.715850:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746240 00000100:00100000:0.0:1789403305.715876:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789403305.715882:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050746240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.715932:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050746240:12345-0@lo:400:kworker.0 Request processed in 49us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.715939:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789403305.715969:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050746240:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.716032:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746624 00000100:00100000:0.0:1789403305.716036:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746624 00000100:00100000:0.0:1789403305.716068:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050746752 00000100:00100000:0.0:1789403305.716071:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050746752 00000100:00100000:0.0:1789403305.716089:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789403305.716095:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050746624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.716127:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050746624:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.716133:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789403305.716142:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789403305.716147:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050746752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.716168:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050746752:12345-0@lo:400:kworker.0 Request processed in 21us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.716173:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789403305.716197:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050746752:0@lo:400:kworker.0 00000100:00100000:0.0:1789403305.716205:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050746624:0@lo:400:kworker.0 00000100:00100000:2.0:1789403305.716630:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050745728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2580us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403305.716640:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789403305.716703:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050745728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403305.717148:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403305.717161:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050747136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403305.717200:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403305.717233:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050747136 00000100:00100000:3.0:1789403305.717238:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050747136 00000100:00080000:1.0:1789403305.723455:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789403305.723469:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403305.723473:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403305.724817:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789403305.724838:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050747136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403305.724878:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403305.725019:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050747136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (7817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.725028:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789403305.725284:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050747136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403305.742711:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.742870:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038089472 00000100:00100000:3.0:1789403305.742882:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038089472 00000100:00100000:3.0:1789403305.742965:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:3.0:1789403305.742978:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+51:11373:x1876325038089472:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1789403305.743090:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743132:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743148:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743164:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743171:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743177:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743269:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743278:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743285:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403305.743346:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743361:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743367:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743385:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743443:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403305.743449:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743458:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743472:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403305.743476:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403305.743482:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743489:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7613a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743509:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743515:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743521:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743526:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403305.743530:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743547:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743556:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:3.0:1789403305.743558:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403305.743562:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743568:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b7613ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743579:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743585:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743591:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743596:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403305.743599:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743605:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743622:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403305.743625:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403305.743628:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.743644:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7613b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403305.743732:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+51:11373:x1876325038089472:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 755us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.743741:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:0.0:1789403305.821082:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403305.821215:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038089728 00000100:00100000:2.0:1789403305.821229:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038089728 00000100:00100000:2.0:1789403305.821303:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:2.0:1789403305.821316:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+51:11376:x1876325038089728:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403305.821345:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403305.821372:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7613bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128879 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821503:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821519:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821532:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821553:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821561:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821567:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821716:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7613d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821725:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7613d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821731:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7613d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403305.821738:0:6501:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:2.0:1789403305.821744:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000004:00020000:2.0:1789403305.821754:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:2.0:1789403305.821842:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821850:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821858:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821864:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403305.821869:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821910:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821925:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:2.0:1789403305.821928:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403305.821934:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821939:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b7613c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821955:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821960:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821965:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821969:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403305.821972:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821977:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.821983:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:2.0:1789403305.821985:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403305.821987:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.822001:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7613c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.822041:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7613bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128879 expref: 54 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.822054:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7613d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128879 expref: 53 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403305.822061:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403305.822063:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403305.822065:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6600, rc 0) 00000100:00100000:2.0:1789403305.822152:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:11376:x1876325038089728:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 840us (1084us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789403305.822160:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:1.0:1789403305.826790:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403305.827006:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038089856 00000100:00100000:0.0:1789403305.827031:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038089856 00000100:00100000:0.0:1789403305.827150:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:0.0:1789403305.827169:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:11376:x1876325038089856:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1789403305.827324:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827355:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827372:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827504:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827514:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827522:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827530:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403305.827535:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827543:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827557:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403305.827560:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789403305.827583:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.827590:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403305.828045:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:11376:x1876325038089856:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 880us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.828056:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:3.0:1789403305.834216:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403305.834438:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038090112 00000100:00100000:2.0:1789403305.834452:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038090112 00000100:00100000:2.0:1789403305.834526:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1789403305.834540:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:11376:x1876325038090112:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1789403305.835193:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11376:x1876325038090112:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 653us (987us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789403305.835203:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:1.0:1789403305.966079:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403305.966226:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038090368 00000100:00100000:0.0:1789403305.966241:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038090368 00000100:00100000:0.0:1789403305.966333:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1789403305.966346:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11385:x1876325038090368:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403305.966380:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403305.966384:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789403305.966469:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761360 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12885d expref: 54 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.966505:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403305.966512:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403305.966530:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128880 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.966678:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b7613ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.966694:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b7613ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.966704:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b7613ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403305.966736:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000004:00020000:0.0:1789403305.966746:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065199170 00010000:00010000:0.0:1789403305.966866:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7613e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128880 expref: 56 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.966882:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b7613ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128880 expref: 55 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.966889:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403305.966891:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403305.966894:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9000, rc 0) 00000100:00100000:0.0:1789403305.966980:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:11385:x1876325038090368:12345-192.168.203.43@tcp:101:bash.0 Request processed in 638us (916us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789403305.966988:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:1.0:1789403305.972522:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403305.972578:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403305.972687:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038090624 00000100:00100000:3.0:1789403305.972702:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038090624 00000100:00100000:3.0:1789403305.972805:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1789403305.972818:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:2390:x1876325038090624:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403305.972838:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403305.972870:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b7613ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128880 expref: 55 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.972894:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403305.972909:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403305.972989:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:2390:x1876325038090624:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 174us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403305.972996:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1789403305.976300:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038090496 00000100:00100000:0.0:1789403305.976322:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038090496 00000100:00100000:0.0:1789403305.976424:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1789403305.976437:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:11385:x1876325038090496:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403305.976471:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403305.976499:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7613fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128887 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.978644:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.978664:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.978699:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.978846:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7613fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 56 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.978870:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 55 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.978879:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403305.978883:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789403305.978887:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9600, rc 0) 00000100:00100000:0.0:1789403305.978996:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:11385:x1876325038090496:12345-192.168.203.43@tcp:101:bash.0 Request processed in 2561us (6492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403305.979005:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:1.0:1789403305.996077:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403305.996211:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038090880 00000100:00100000:0.0:1789403305.996224:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038090880 00000100:00100000:0.0:1789403305.996302:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:0.0:1789403305.996314:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:11385:x1876325038090880:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:0.0:1789403305.996424:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403305.996460:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7613d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128879 expref: 55 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403305.996482:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403305.996489:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403305.996980:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.996998:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.997010:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789403305.997075:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789403305.997100:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015e5bdbf reply state 00000000fcb410ad transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.997113:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403305.997120:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403305.997123:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789403305.997125:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789403305.997234:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:11385:x1876325038090880:12345-192.168.203.43@tcp:36:bash.0 Request processed in 922us (1172us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789403305.997242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000020:00080000:3.0:1789403305.997247:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789403306.002514:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.002651:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038091008 00000100:00100000:0.0:1789403306.002698:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038091008 00000100:00100000:0.0:1789403306.002780:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:0.0:1789403306.002792:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:11385:x1876325038091008:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403306.002821:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403306.002845:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76140f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12888e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.002980:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.002998:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.003013:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403306.003047:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789403306.003052:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403306.003074:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.003116:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76140f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 59 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.003138:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 58 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.003147:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403306.003150:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403306.003154:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8800, rc 0) 00000100:00100000:0.0:1789403306.003233:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:11385:x1876325038091008:12345-192.168.203.43@tcp:101:bash.0 Request processed in 443us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.003241:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00080000:1.0:1789403306.003756:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403306.008551:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.008651:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038091264 00000100:00100000:2.0:1789403306.008665:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038091264 00000100:00100000:2.0:1789403306.008738:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:2.0:1789403306.008751:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:11385:x1876325038091264:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:2.0:1789403306.009093:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:11385:x1876325038091264:12345-192.168.203.43@tcp:35:bash.0 Request processed in 344us (555us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789403306.009101:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:1.0:1789403306.132098:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.132203:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038091392 00000100:00100000:0.0:1789403306.132216:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038091392 00000100:00100000:0.0:1789403306.132288:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:0.0:1789403306.132301:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:11392:x1876325038091392:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403306.132335:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403306.132361:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76141d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128895 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.132568:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.132585:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.132599:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403306.132658:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789403306.132663:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403306.132685:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.132713:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76141d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128895 expref: 61 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.132734:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128895 expref: 60 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.132761:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403306.132764:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403306.132769:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9800, rc 0) 00000100:00100000:0.0:1789403306.132832:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:11392:x1876325038091392:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 534us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.132841:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:0.0:1789403306.140151:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403306.140356:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038091520 00000100:00100000:3.0:1789403306.140377:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038091520 00000100:00100000:3.0:1789403306.140493:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1789403306.140506:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:11392:x1876325038091520:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403306.140534:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403306.140559:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76142b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12889c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140643:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140660:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140692:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140704:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140710:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140717:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140802:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140811:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140817:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403306.140867:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789403306.140871:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403306.140891:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140912:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140921:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140936:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140942:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140948:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403306.140953:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140961:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140975:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403306.140978:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403306.140983:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.140989:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761432 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141004:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141010:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141015:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141019:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403306.141029:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141035:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141041:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:3.0:1789403306.141043:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403306.141046:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141051:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141078:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b76142b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141090:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.141097:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403306.141099:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403306.141102:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185800, rc 0) 00000100:00100000:3.0:1789403306.141184:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11392:x1876325038091520:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 682us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403306.141192:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:1.0:1789403306.162968:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403306.163012:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.163116:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038091904 00000100:00100000:0.0:1789403306.163129:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038091904 00000100:00100000:0.0:1789403306.163198:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:0.0:1789403306.163219:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11392:x1876325038091904:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403306.163521:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403306.163552:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761447 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288a3 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.163715:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.163733:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.163742:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.163751:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.163812:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.163829:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 62 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403306.163844:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050747264:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403306.164222:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.164232:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403306.164810:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050747392:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403306.164864:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528180 going to sleep for 11 seconds 00000100:00100000:3.0:1789403306.165076:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038091648 00000100:00100000:3.0:1789403306.165101:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038091648 00010000:00010000:3.0:1789403306.165143:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 63 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403306.168583:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00010000:00010000:2.0:1789403306.169490:0:6499:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.43@tcp) returned -22 from blocking AST (req@00000000cdec791c x1876325050747264) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 63 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.169532:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 63 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.169561:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12889c expref: 63 pid: 6500 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403306.169581:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050747264:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403306.170001:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:2389:x1876325038091648:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403306.170026:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403306.170030:0:10319:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 5fb08b1e5b761440) 00010000:00010000:0.0:1789403306.170031:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403306.170103:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:2389:x1876325038091648:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1503us (7147us total) trans 0 rc 116/116 00000100:00100000:0.0:1789403306.170111:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:2.0:1789403306.171930:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050747392:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403306.171966:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403306.171975:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.171989:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.172000:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403306.176049:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.176318:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038092032 00000100:00100000:0.0:1789403306.176331:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038092032 00010000:00010000:0.0:1789403306.176385:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403306.176528:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:0.0:1789403306.176542:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:2390:x1876325038092032:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403306.176564:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403306.176573:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.176588:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.176632:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12888e expref: 62 pid: 6499 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.176654:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403306.176660:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.176672:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.176681:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.176719:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403306.176792:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:2390:x1876325038092032:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 253us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.176800:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00010000:00010000:2.0:1789403306.177710:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.177737:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403306.177762:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00020000:2.0:1789403306.177785:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192008195 00010000:00010000:2.0:1789403306.177950:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761447 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 62 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.177971:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 61 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.177980:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403306.177983:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789403306.177986:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9000, rc 0) 00000100:00100000:2.0:1789403306.178042:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11392:x1876325038091904:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 14824us (15028us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789403306.178051:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:2.0:1789403306.182485:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.182751:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038092288 00000100:00100000:0.0:1789403306.182780:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038092288 00000100:00100000:0.0:1789403306.182892:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1789403306.182912:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11392:x1876325038092288:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:0.0:1789403306.182930:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403306.182960:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b76139f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128872 expref: 61 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.182982:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403306.182987:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403306.183227:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:11392:x1876325038092288:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 324us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.183236:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1789403306.190100:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.191053:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038092416 00000100:00100000:2.0:1789403306.191069:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038092416 00000100:00100000:2.0:1789403306.191648:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:2.0:1789403306.191663:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:11392:x1876325038092416:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:2.0:1789403306.191825:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.191847:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.191873:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403306.192008:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789403306.192136:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:11392:x1876325038092416:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 477us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.192145:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:2.0:1789403306.196722:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403306.196829:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038092544 00000100:00100000:3.0:1789403306.196843:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038092544 00000100:00100000:3.0:1789403306.196963:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1789403306.196976:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:11392:x1876325038092544:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403306.197004:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403306.197031:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288aa expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.197116:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.197129:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 61 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.197151:0:9061:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.197166:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 61 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.197182:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403306.197186:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403306.197190:0:9061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 61 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.197198:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185600, rc 0) 00000100:00100000:3.0:1789403306.197298:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11392:x1876325038092544:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 324us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403306.197324:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00010000:00010000:1.0:1789403306.481876:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789403306.737694:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789403306.737710:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403306.737753:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789403306.737765:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789403306.737955:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14420ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050747520:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789403306.738123:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403306.747916:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.749608:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038092672 00000100:00100000:0.0:1789403306.749626:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038092672 00000100:00100000:0.0:1789403306.749708:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:0.0:1789403306.749731:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038092672:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789403306.749774:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789403306.749934:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038092672:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 216us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.749942:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1789403306.752933:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14420ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050747520:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789403306.758920:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.759015:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038092800 00000100:00100000:2.0:1789403306.759030:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038092800 00000100:00100000:2.0:1789403306.759110:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:2.0:1789403306.759123:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11393:x1876325038092800:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789403306.759242:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759264:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759280:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759297:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759566:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759575:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759635:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759647:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759655:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403306.759718:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789403306.759724:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403306.759741:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759755:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759762:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759770:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759776:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403306.759781:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759791:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759805:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:2.0:1789403306.759817:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403306.759825:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759832:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b76146a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759849:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759856:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759863:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759869:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403306.759872:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759879:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759887:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff90a141a01200) 00010000:00010000:2.0:1789403306.759890:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403306.759893:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759913:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761471 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759933:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759945:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759952:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759957:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403306.759960:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759967:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759975:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403306.759977:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403306.759980:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.759986:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761478 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403306.760094:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11393:x1876325038092800:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 972us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.760103:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:0.0:1789403306.771060:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403306.773964:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038093056 00000100:00100000:3.0:1789403306.773986:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038093056 00000100:00100000:3.0:1789403306.774090:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:3.0:1789403306.774103:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:11393:x1876325038093056:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403306.774131:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403306.774159:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76147f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288b1 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.774313:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.774332:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.774346:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403306.774360:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00020000:3.0:1789403306.774369:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:3.0:1789403306.803852:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.803874:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.803884:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.803922:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403306.803928:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.803937:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.803956:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403306.803959:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789403306.803965:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.803971:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761486 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.804043:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76147f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288b1 expref: 63 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.804056:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:3.0:1789403306.804058:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403306.804063:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76147f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288b1 expref: 63 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.804073:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185a00, rc 0) 00000100:00100000:3.0:1789403306.804172:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038093056:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 30071us (33126us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789403306.811194:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:3.0:1789403306.824577:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.824730:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038093184 00000100:00100000:2.0:1789403306.824744:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038093184 00000100:00100000:2.0:1789403306.824822:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:2.0:1789403306.824834:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038093184:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789403306.824883:0:6500:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789403306.825056:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038093184:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 224us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.825066:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:2.0:1789403306.902839:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.902974:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038093440 00000100:00100000:0.0:1789403306.902987:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038093440 00000100:00100000:0.0:1789403306.903063:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1789403306.903076:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038093440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403306.903123:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403306.903128:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789403306.903163:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128895 expref: 62 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.903189:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403306.903196:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403306.903211:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761494 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288b8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789403306.905877:0:6501:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789403306.906213:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76149b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.906236:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76149b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.906261:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76149b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789403306.906271:0:6501:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:0.0:1789403306.906306:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:0.0:1789403306.906383:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761494 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288b8 expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.906457:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76149b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288b8 expref: 63 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.906467:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a243d8b300) 00010000:00010000:0.0:1789403306.906493:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403306.906497:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9a00, rc 0) 00000100:00100000:0.0:1789403306.906574:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:11393:x1876325038093440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 3500us (3749us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789403306.906581:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1789403306.924346:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403306.924644:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038093696 00000100:00100000:3.0:1789403306.924658:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038093696 00000100:00100000:3.0:1789403306.924739:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1789403306.924750:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:11393:x1876325038093696:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789403306.924826:0:9061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403306.924861:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76149b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288b8 expref: 63 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.924884:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a243d8b300) 00010000:00010000:3.0:1789403306.924910:0:9061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403306.924936:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.924952:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.924964:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.924979:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.924985:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.924992:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925046:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925073:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925080:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925087:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403306.925092:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925100:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925109:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:3.0:1789403306.925112:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403306.925117:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925123:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7614a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925133:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925139:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925145:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925151:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403306.925159:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925166:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925173:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x685bd7ab (ffff90a1434a9c00) 00010000:00010000:3.0:1789403306.925175:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403306.925178:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.925184:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b7614b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x685bd7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403306.925294:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038093696:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 545us (963us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789403306.925454:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1789403306.927938:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403306.928036:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038093824 00000100:00100000:1.0:1789403306.928047:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038093824 00000100:00100000:1.0:1789403306.928108:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:1.0:1789403306.928120:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:11393:x1876325038093824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403306.928145:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403306.928170:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b7614b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288bf expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403306.928212:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403306.928226:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403306.928238:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403306.928545:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b7614b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 64 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403306.928567:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 63 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403306.928584:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:1.0:1789403306.928587:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403306.928592:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062800, rc 0) 00000100:00100000:1.0:1789403306.928810:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:11393:x1876325038093824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 691us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403306.928818:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:0.0:1789403306.939137:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.939932:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038094080 00000100:00100000:2.0:1789403306.939947:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038094080 00000100:00100000:2.0:1789403306.940065:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:2.0:1789403306.940078:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:11393:x1876325038094080:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789403306.940192:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.940213:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.940228:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403306.940689:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789403306.940702:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352939312348ns, next at 353939308929ns, rc = 0 00000004:00010000:2.0:1789403306.940758:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9ca746 reply state 0000000089c55608 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.940772:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.940780:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403306.940783:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789403306.940788:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403306.940974:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:11393:x1876325038094080:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 897us (1850us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789403306.941003:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:0.0:1789403306.944065:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.944209:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038094208 00000100:00100000:2.0:1789403306.944222:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038094208 00000100:00100000:2.0:1789403306.944325:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:2.0:1789403306.944337:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:11393:x1876325038094208:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403306.944368:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403306.944429:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288c6 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.944504:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.944521:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.944544:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403306.944548:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403306.944552:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7000, rc 0) 00000100:00100000:2.0:1789403306.944722:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:11393:x1876325038094208:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 386us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.944730:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:1.0:1789403306.949057:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.949288:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038094336 00000100:00100000:0.0:1789403306.949357:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038094336 00000100:00100000:0.0:1789403306.949503:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1789403306.949516:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038094336:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789403306.949802:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2389:x1876325038094336:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 288us (758us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789403306.949812:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1789403306.952352:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403306.952540:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038094592 00000100:00100000:3.0:1789403306.952553:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038094592 00000100:00100000:3.0:1789403306.952630:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403306.952643:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:11393:x1876325038094592:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789403306.952943:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:11393:x1876325038094592:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 302us (601us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789403306.952952:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403306.955269:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.955474:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038094848 00000100:00100000:2.0:1789403306.955487:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038094848 00000100:00100000:2.0:1789403306.955560:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:2.0:1789403306.955573:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:11393:x1876325038094848:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789403306.955703:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:11393:x1876325038094848:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.955727:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00080000:1.0:1789403306.960130:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403306.960681:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.961063:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038094976 00000100:00100000:2.0:1789403306.961087:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038094976 00000100:00100000:2.0:1789403306.961163:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:2.0:1789403306.961175:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:11393:x1876325038094976:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403306.961201:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403306.961226:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288cd expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.961704:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7614da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.961722:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7614da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.961737:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7614da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403306.961790:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403306.961813:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7614da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.961845:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288cd expref: 69 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.961867:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7614da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288cd expref: 68 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.961875:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403306.961886:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789403306.961891:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6000, rc 0) 00000100:00100000:2.0:1789403306.961985:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:11393:x1876325038094976:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 812us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.961993:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:2.0:1789403306.966034:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.966197:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038095104 00000100:00100000:0.0:1789403306.966210:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038095104 00000100:00100000:0.0:1789403306.966499:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1789403306.966512:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038095104:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403306.966534:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403306.966562:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288d4 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403306.966704:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa820ab, blocks: 0x0 00010000:00010000:0.0:1789403306.966732:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789403306.966752:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403306.966762:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 10 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.966784:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 10 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.966799:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8600, rc 0) 00000100:00100000:0.0:1789403306.966872:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:2390:x1876325038095104:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 363us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.966880:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1789403306.968961:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.969349:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038095360 00000100:00100000:2.0:1789403306.969358:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038095360 00000100:00100000:2.0:1789403306.969526:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:2.0:1789403306.969539:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:11393:x1876325038095360:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789403306.969685:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:11393:x1876325038095360:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 149us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403306.969692:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:1.0:1789403306.971944:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403306.972045:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038095488 00000100:00100000:2.0:1789403306.972056:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038095488 00000100:00100000:2.0:1789403306.972215:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1789403306.972226:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:11393:x1876325038095488:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403306.972248:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403306.972270:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288db expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.972309:0:8563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.972319:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403306.972323:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403306.972344:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 11 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.972385:0:8563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403306.972464:0:8563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403306.972481:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8563:1876325050747648:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403306.972634:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403306.978244:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.978940:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8563:1876325050747648:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403306.978989:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 11 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403306.979016:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7200, rc 0) 00000100:00100000:0.0:1789403306.979099:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144208380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:11393:x1876325038095488:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6874us (7164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403306.979110:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403306.979426:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038095616 00000100:00100000:3.0:1789403306.979452:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038095616 00010000:00010000:3.0:1789403306.979496:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403306.979531:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:3.0:1789403306.979541:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:2390:x1876325038095616:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403306.979559:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403306.979586:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.979615:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.979644:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b7614e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288d4 expref: 11 pid: 8417 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.979661:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403306.979666:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403306.979676:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 10 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.979688:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 10 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403306.979731:0:10319:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 10 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403306.979762:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10319:1876325050747776:192.168.203.43@tcp:105: 00000100:00100000:3.0:1789403306.979834:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403306.983657:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403306.983917:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038095744 00000100:00100000:0.0:1789403306.983929:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038095744 00002000:00100000:0.0:1789403306.983993:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90a144208e00 x1876325038095744/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:467/0 lens 504/0 e 0 to 0 dl 1789403317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789403306.984006:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a144208e00 with x1876325038095744 ext(0->12) 00002000:00010000:0.0:1789403306.984013:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a144208e00 00000100:00100000:0.0:1789403306.984052:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1789403306.984090:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:2390:x1876325038095744:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789403306.984943:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10319:1876325050747776:192.168.203.43@tcp:105: 00010000:00010000:3.0:1789403306.984974:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403306.985052:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:2390:x1876325038095616:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5512us (6820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403306.985062:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1789403306.985800:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2390:x1876325038095744:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 1719us (2153us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789403306.985816:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00002000:00100000:1.0:1789403306.985828:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90a144208e00 x1876325038095744/t4294967309(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:467/0 lens 504/448 e 0 to 0 dl 1789403317 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789403306.985839:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a144208e00 with x1876325038095744 ext(0->12) 00002000:00010000:1.0:1789403306.985845:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a144208e00 00000100:00100000:1.0:1789403307.003288:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403307.003453:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038095872 00000100:00100000:0.0:1789403307.003466:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038095872 00000100:00100000:0.0:1789403307.003546:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:0.0:1789403307.003559:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:11393:x1876325038095872:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789403307.006287:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1789403307.006308:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:2.0:1789403307.006425:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006440:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006449:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006455:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.006460:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006470:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006496:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a1425eb500) 00010000:00010000:2.0:1789403307.006500:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403307.006522:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006528:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7611ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006563:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006570:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006576:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006581:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.006584:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006590:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006598:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a1425eb000) 00010000:00010000:2.0:1789403307.006600:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403307.006604:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006620:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b761295 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006635:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006642:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006655:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006661:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.006664:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006671:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006681:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:2.0:1789403307.006683:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403307.006687:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006693:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b761313 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006706:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006712:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006718:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006724:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.006727:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006745:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006753:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a1425eb900) 00010000:00010000:2.0:1789403307.006756:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403307.006759:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006765:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761336 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006782:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006789:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006794:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006800:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.006803:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006809:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006817:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403307.006819:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403307.006822:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006838:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761408 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006851:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006857:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006863:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006867:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.006870:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006876:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006884:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403307.006886:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789403307.006889:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.006906:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7614c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789403307.007102:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789403307.007130:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a143657900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789403307.007135:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a1426bab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a2615c4e40 00000020:00080000:3.0:1789403307.007139:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a1426ba200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a143553600 00000004:00080000:3.0:1789403307.007163:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789403307.007218:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789403307.007433:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403307.007456:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050747904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789403307.007547:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403307.007628:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050747904 00000100:00100000:2.0:1789403307.007637:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050747904 00000100:00100000:2.0:1789403307.007702:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789403307.007712:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050747904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789403307.007746:0:8416:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1789403307.007787:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa820a9, atime: 0x6aa820a9, ctime: 0x6aa820a9, blocks: 0x8 00010000:00010000:2.0:1789403307.007795:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.007814:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1789403307.007819:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403307.007827:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.007844:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.007853:0:8416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.007861:0:8416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.007881:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789403307.008093:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1876325050747904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 382us (544us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789403307.008101:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789403307.008136:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403307.008143:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.008152:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403307.008156:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.008165:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.008180:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.008189:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003297a618/0x5fb08b1e5b7614ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.008209:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403307.008211:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403307.008212:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789403307.008253:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a250e29180/2, rc 0, transno 4294967305 00000100:00100000:2.0:1789403307.008260:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050747904:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789403307.009269:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403307.010102:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050748160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789403307.010174:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403307.010216:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403307.010223:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050748032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789403307.010249:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403307.010284:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050748160 00000100:00100000:0.0:1789403307.010292:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050748160 00000100:00100000:0.0:1789403307.010344:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050748032 00000100:00100000:0.0:1789403307.010348:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050748032 00000100:00100000:0.0:1789403307.010374:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403307.010384:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3629:x1876325050748160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789403307.010559:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789403307.010563:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789403307 00002000:00010000:0.0:1789403307.010566:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789403307.010569:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789403307 -> 1789403307 00002000:00010000:0.0:1789403307.010571:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789403307.010615:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3629:x1876325050748160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (440us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789403307.010624:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403307.010645:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403307.010651:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3629:x1876325050748032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789403307.010679:0:8417:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1789403307.010700:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.010726:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 11 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.010736:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1789403307.010741:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403307.010747:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.010779:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 11 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.010795:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 11 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403307.010809:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876325050748288:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403307.010882:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27c528480 going to sleep for 11 seconds 00000004:00080000:0.0:1789403307.010941:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a144180700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789403307.010947:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050748160:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789403307.011699:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1789403307.011890:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a261643000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789403307.011906:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a281bb0b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a261643180 00000020:00080000:3.0:1789403307.011910:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a281bb0600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a142567a00 00000100:00100000:2.0:1789403307.012151:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11393:x1876325038095872:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 8592us (8874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403307.012162:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 136 00000020:00080000:1.0:1789403307.012415:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789403307.012489:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789403307.016465:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403307.016596:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038096000 00000100:00100000:2.0:1789403307.016609:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038096000 00010000:00010000:2.0:1789403307.016667:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 12 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.016709:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:2.0:1789403307.016720:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a606050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2389:x1876325038096000:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403307.016737:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403307.016744:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 12 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.016760:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 12 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.016795:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403307.016800:0:7451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403307.016807:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.016817:0:7451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.016843:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403307.016921:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a606050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2389:x1876325038096000:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 203us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403307.016929:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00010000:00010000:0.0:1789403307.017087:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac59a375/0x5fb08b1e5b7612a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128833 expref: 11 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403307.017118:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876325050748288:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403307.017143:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.017154:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.017161:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.017171:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.017179:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.017204:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789403307.017431:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c721050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3629:x1876325050748032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6779us (7179us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789403307.017439:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1789403307.017638:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a144181f80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789403307.017645:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050748032:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789403307.017988:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403307.017998:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.018023:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403307.018027:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.018040:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.018056:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.018065:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7614f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.018097:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403307.018099:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403307.018101:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403307.030628:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403307.032710:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038096128 00000100:00100000:0.0:1789403307.032729:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038096128 00000100:00100000:1.0:1789403307.035499:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1789403307.035519:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:2389:x1876325038096128:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789403307.038257:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789403307.038280:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789403307.039872:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038096128:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 4346us (9257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403307.039888:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1789403307.049806:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403307.049927:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038096384 00000100:00100000:2.0:1789403307.049941:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038096384 00000100:00100000:2.0:1789403307.050014:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:2.0:1789403307.050028:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11393:x1876325038096384:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789403307.050209:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403307.050246:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b7614da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288cd expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.050270:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403307.050292:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403307.050332:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.050348:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.050361:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403307.050576:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff9408ec reply state 0000000002d94fac transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.050591:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.050909:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403307.050913:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403307.050916:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403307.051095:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:11393:x1876325038096384:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1068us (1302us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789403307.051103:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:3.0:1789403307.060678:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403307.060853:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038096512 00000100:00100000:0.0:1789403307.060867:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038096512 00000100:00100000:0.0:1789403307.060954:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1789403307.060966:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038096512:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789403307.061244:0:8563:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789403307.061249:0:8563:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789403307 -> 1789403306 00002000:00010000:0.0:1789403307.061252:0:8563:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789403305 00002000:00010000:0.0:1789403307.061254:0:8563:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789403307 -> 1789403306 00002000:00010000:0.0:1789403307.061257:0:8563:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789403307.061334:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038096512:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 369us (672us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789403307.061344:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1789403307.068941:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403307.072230:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038096768 00000100:00100000:3.0:1789403307.072252:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038096768 00000100:00100000:3.0:1789403307.072465:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:3.0:1789403307.072479:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:11393:x1876325038096768:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789403307.072578:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.072715:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 17 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.072728:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.072776:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 17 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.072792:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 17 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403307.072808:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050748416:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403307.072932:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403307.076461:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050748416:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403307.076506:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.082407:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403307.082690:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038096896 00000100:00100000:0.0:1789403307.082703:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038096896 00010000:00010000:0.0:1789403307.082757:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 18 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403307.082805:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:0.0:1789403307.082817:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2389:x1876325038096896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403307.082836:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403307.082843:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 18 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.082859:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 18 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.082886:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7614be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288bf expref: 18 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.082932:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:0.0:1789403307.082938:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.082949:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.082959:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.083001:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403307.083083:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:2389:x1876325038096896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 267us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403307.083091:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00010000:00010000:2.0:1789403307.083819:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083831:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083883:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083919:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083928:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083935:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.083940:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083949:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083962:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403307.083965:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789403307.083970:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.083976:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761504 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.084044:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11393:x1876325038096768:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 11567us (15115us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789403307.084055:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1789403307.098826:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403307.098928:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038097024 00000100:00100000:2.0:1789403307.098941:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038097024 00000100:00100000:2.0:1789403307.099017:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:2.0:1789403307.099030:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038097024:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789403307.099096:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.099135:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 7 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.099143:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789403307.099148:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403307.099153:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.099194:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 7 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.099209:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 7 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.099225:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876325050748544:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403307.099321:0:8416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403307.101723:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403307.102204:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038097152 00000100:00100000:0.0:1789403307.102217:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038097152 00010000:00010000:0.0:1789403307.102267:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 8 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403307.102316:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 75 00000100:00100000:0.0:1789403307.102328:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038097152:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403307.102347:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403307.102375:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 8 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.102422:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 8 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.102471:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403307.102476:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403307.102482:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.102494:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.102520:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403307.102587:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038097152:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 261us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403307.102608:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 75 00010000:00010000:2.0:1789403307.103299:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b7614e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288db expref: 7 pid: 8563 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.103321:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876325050748544:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403307.103351:0:8416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103363:0:8416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103383:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103457:0:8416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103467:0:8416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103475:0:8416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103483:0:8416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403307.103489:0:8416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103501:0:8416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103518:0:8416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.103525:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001838dfd4/0x5fb08b1e5b76150b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.103623:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038097024:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 4595us (4811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403307.103633:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1789403307.114983:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403307.117565:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038097408 00000100:00100000:1.0:1789403307.117587:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038097408 00000100:00100000:1.0:1789403307.117682:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:1.0:1789403307.117695:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:11393:x1876325038097408:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789403307.117810:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.117834:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 16 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.117846:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.117905:0:9061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 16 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.117922:0:9061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 16 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403307.117939:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050748672:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403307.118048:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403307.123512:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403307.123763:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050748672:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403307.123794:0:9061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403307.123923:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038097536 00000100:00100000:3.0:1789403307.123931:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038097536 00010000:00010000:3.0:1789403307.123980:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 17 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403307.124040:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 76 00000100:00100000:3.0:1789403307.124053:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:2390:x1876325038097536:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403307.124071:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403307.124089:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 17 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124102:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 17 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124127:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128887 expref: 17 pid: 13788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124146:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403307.124152:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 16 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124164:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124173:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124192:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.124293:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403307.124435:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:2390:x1876325038097536:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 383us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403307.124452:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 76 00010000:00010000:1.0:1789403307.125143:0:9061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.125156:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.127422:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.127456:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.127467:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.127526:0:9061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 16 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.127545:0:9061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 16 pid: 6500 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403307.127562:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050748800:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403307.128157:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403307.132439:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403307.132706:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038097664 00000100:00100000:3.0:1789403307.132718:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038097664 00010000:00010000:3.0:1789403307.132770:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 17 pid: 6500 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403307.132818:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:3.0:1789403307.132831:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:2390:x1876325038097664:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403307.132850:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403307.132858:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 17 pid: 6500 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.132873:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 17 pid: 6500 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.132913:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:3.0:1789403307.132919:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.132932:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.132942:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.132967:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403307.133029:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+17:2390:x1876325038097664:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 200us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403307.133058:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00010000:00010000:1.0:1789403307.134020:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b7614cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288c6 expref: 16 pid: 6500 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403307.134061:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050748800:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403307.134102:0:9061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.134112:0:9061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.134118:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403307.134369:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1789403307.134554:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1789403307.134591:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789403307.134691:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9061:1876325050748928:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789403307.134755:0:9061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403307.134787:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403307.135686:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050748928 00000100:00100000:0.0:1789403307.135698:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050748928 00000100:00100000:0.0:1789403307.135764:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789403307.135776:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9061:x1876325050748928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789403307.135913:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9061:x1876325050748928:12345-0@lo:1000:mdt00_003.0 Request processed in 139us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403307.135920:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789403307.136992:0:9061:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789403307.137003:0:9061:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1789403307.137028:0:9061:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a144180700, transno 4294967310 00000004:00080000:2.0:1789403307.137049:0:9061:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a144181f80, transno 4294967311 00000100:00100000:2.0:1789403307.137058:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144208000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9061:1876325050748928:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789403307.137279:0:9061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789403307.137367:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9061:1876325050749056:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789403307.137481:0:9061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403307.137514:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142149180 going to sleep for 11 seconds 00000100:00100000:3.0:1789403307.138643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050749056 00000100:00100000:3.0:1789403307.138659:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050749056 00000100:00100000:3.0:1789403307.138722:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789403307.138735:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9061:x1876325050749056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789403307.138974:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9061:x1876325050749056:12345-0@lo:1000:mdt00_003.0 Request processed in 241us (1491us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789403307.138983:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789403307.139861:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9061:1876325050749056:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789403307.139941:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.139952:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.139960:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.139967:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.139972:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.139980:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140020:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403307.140023:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403307.140029:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140036:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761519 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140065:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140071:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140089:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140095:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.140098:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140103:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140111:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403307.140114:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403307.140123:0:9061:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 19 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140136:0:9061:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 19 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.140154:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 19 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.141142:0:9061:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 19 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.141165:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050749184:192.168.203.43@tcp:105: 00000100:00100000:2.0:1789403307.141948:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403307.148587:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403307.148723:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050749184:192.168.203.43@tcp:105: 00010000:00010000:2.0:1789403307.148760:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148774:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76145c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148818:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148837:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148851:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148862:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148868:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148886:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148902:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.148908:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148917:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148932:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403307.148936:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403307.148940:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148946:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761520 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148956:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148962:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148967:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148972:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403307.148975:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.148992:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.149000:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403307.149002:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403307.149005:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.149010:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b761512 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403307.149457:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789403307.149464:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403307.149966:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789403307.149977:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789403307.150350:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11393:x1876325038097408:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 32653us (35378us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789403307.150365:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000020:00080000:2.0:1789403307.150373:0:9061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789403307.150769:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038097792 00000100:00100000:3.0:1789403307.150780:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038097792 00000100:00100000:3.0:1789403307.150844:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:3.0:1789403307.150855:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11392:x1876325038097792:12345-192.168.203.43@tcp:49:lfs.0 00000100:00100000:3.0:1789403307.151000:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11392:x1876325038097792:12345-192.168.203.43@tcp:49:lfs.0 Request processed in 147us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403307.151006:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1789403307.154937:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403307.155120:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038098048 00000100:00100000:2.0:1789403307.155135:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038098048 00000100:00100000:2.0:1789403307.155217:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:2.0:1789403307.155228:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11392:x1876325038098048:12345-192.168.203.43@tcp:58:lfs.0 00000040:00080000:2.0:1789403307.155486:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789403307.155584:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11392:x1876325038098048:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 357us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403307.155592:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:1.0:1789403307.161678:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403307.161820:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038098304 00000100:00100000:3.0:1789403307.161833:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038098304 00000100:00100000:3.0:1789403307.161915:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:3.0:1789403307.161929:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:11393:x1876325038098304:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789403307.162315:0:6503:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789403307.162361:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789403307.162442:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.162464:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.162505:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.162516:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.162523:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.162530:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.162545:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789403307.162691:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:11393:x1876325038098304:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 764us (1030us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789403307.162701:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000020:00080000:3.0:1789403307.162707:0:6503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789403307.163544:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403307.163554:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.163562:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403307.163567:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.163592:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.163618:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:1.0:1789403307.163621:0:8431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789403307.163628:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.163634:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761527 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403307.163650:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403307.163652:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403307.163654:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403307.215017:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403307.215126:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038098432 00000100:00100000:2.0:1789403307.215138:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038098432 00000100:00100000:2.0:1789403307.215213:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:2.0:1789403307.215225:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:11396:x1876325038098432:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403307.215284:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403307.215312:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76152e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288e2 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215433:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215451:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215465:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215481:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215488:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215496:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215588:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215613:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215623:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215666:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 22 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403307.215691:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 22 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403307.215707:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050749312:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403307.215824:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431d4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789403307.220114:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403307.220453:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6500:1876325050749312:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403307.220487:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403307.221002:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038098688 00000100:00100000:0.0:1789403307.221013:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038098688 00000100:00100000:0.0:1789403307.221105:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1789403307.221117:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:9914:x1876325038098688:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789403307.222096:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:9914:x1876325038098688:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 974us (1988us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789403307.222108:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:1.0:1789403307.225800:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403307.225915:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038098816 00000100:00100000:3.0:1789403307.225928:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038098816 00010000:00010000:3.0:1789403307.225980:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 24 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403307.226085:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:3.0:1789403307.226097:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:2390:x1876325038098816:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403307.226135:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403307.226144:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 24 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.226159:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 24 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.226187:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b76144e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288a3 expref: 24 pid: 6499 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.226207:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403307.226213:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.226223:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.226232:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403307.226290:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403307.226361:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:2390:x1876325038098816:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 266us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403307.226369:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00010000:00010000:0.0:1789403307.226478:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226488:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403307.226555:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789403307.226560:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403307.226585:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226622:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226633:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226639:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226646:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226653:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403307.226658:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226678:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226687:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:0.0:1789403307.226690:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403307.226695:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226700:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761535 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226711:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226716:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226722:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226726:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403307.226729:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226735:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226740:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a141a01600) 00010000:00010000:0.0:1789403307.226743:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403307.226745:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226758:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b76153c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226801:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b76152e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288e2 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226814:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288e2 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403307.226822:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403307.226824:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403307.226827:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7000, rc 0) 00000100:00100000:0.0:1789403307.226855:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11396:x1876325038098432:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 11633us (11856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403307.226862:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 141 00010000:00010000:1.0:1789403307.505575:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403308.198368:0:14293:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789403308.198379:0:14293:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789403308.198907:0:14293:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789403308.198915:0:14293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789403308.209756:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789403308.209765:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403308.209791:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789403308.209799:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789403308.209941:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144208700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050749440:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789403308.210034:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403308.214478:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403308.215484:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144208700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050749440:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789403308.217118:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038098944 00000100:00100000:3.0:1789403308.217142:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038098944 00000100:00100000:3.0:1789403308.217202:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:3.0:1789403308.217216:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11407:x1876325038098944:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789403308.217249:0:9061:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789403308.217405:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11407:x1876325038098944:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 176us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403308.217413:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00080000:1.0:1789403308.217604:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403308.234820:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403308.234905:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038099200 00000100:00100000:3.0:1789403308.234917:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038099200 00000100:00100000:3.0:1789403308.234982:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:3.0:1789403308.234995:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:11407:x1876325038099200:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403308.235016:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403308.235040:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76154a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288e9 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403308.235152:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403308.235169:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403308.235183:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403308.235194:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00020000:3.0:1789403308.235204:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:3.0:1789403308.235317:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76154a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288e9 expref: 25 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403308.236581:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288e9 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403308.236590:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:3.0:1789403308.236593:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403308.236596:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184400, rc 0) 00000100:00100000:3.0:1789403308.238427:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:11407:x1876325038099200:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 3424us (3605us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789403308.238440:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:1.0:1789403308.251948:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403308.254853:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038099456 00000100:00100000:0.0:1789403308.254869:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038099456 00000100:00100000:0.0:1789403308.254944:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1789403308.254957:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:11407:x1876325038099456:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789403308.255039:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255058:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255070:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255235:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255243:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255250:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255256:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403308.255261:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255269:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255297:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:0.0:1789403308.255301:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789403308.255306:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403308.255313:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76155f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403308.256261:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:11407:x1876325038099456:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 1300us (4317us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789403308.256272:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000040:00080000:0.0:1789403308.256435:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403308.256440:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403308.258133:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789403308.258161:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403308.263992:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403308.264058:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038099584 00000100:00100000:2.0:1789403308.264068:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038099584 00000100:00100000:2.0:1789403308.264133:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1789403308.264144:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:2387:x1876325038099584:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403308.264158:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403308.264183:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288e9 expref: 25 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403308.264202:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403308.264207:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403308.264268:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:2387:x1876325038099584:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 125us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403308.264276:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1789403308.266230:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403308.266296:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038099840 00000100:00100000:3.0:1789403308.266305:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038099840 00000100:00100000:3.0:1789403308.266478:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1789403308.266489:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:11407:x1876325038099840:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789403308.266948:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:11407:x1876325038099840:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 461us (724us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789403308.266957:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00010000:00010000:2.0:1789403308.529525:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403308.620546:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403308.620629:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403308.620661:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403308.620694:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100352 00000100:00100000:1.0:1789403308.620704:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100352 00000100:00100000:1.0:1789403308.620779:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:1.0:1789403308.620789:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038100352:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403308.620895:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038100352:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403308.620904:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00080000:3.0:1789403308.621114:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403308.623675:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403308.623712:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403308.623752:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038099968 00000100:00100000:3.0:1789403308.623762:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038099968 00000100:00100000:3.0:1789403308.623814:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 382 00000100:00100000:3.0:1789403308.623836:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038099968:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403308.623912:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038099968:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403308.623920:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 382 00000100:00100000:2.0:1789403308.625643:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100096 00000100:00100000:2.0:1789403308.625653:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100096 00000100:00100000:1.0:1789403308.625795:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100608 00000100:00100000:1.0:1789403308.625800:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100608 00000100:00100000:1.0:1789403308.625844:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 292 00000100:00100000:1.0:1789403308.625853:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:2387:x1876325038100096:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403308.625919:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 293 00000100:00100000:1.0:1789403308.625928:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:2387:x1876325038100096:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (5390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403308.625931:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038100608:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403308.625938:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 292 00000100:00100000:2.0:1789403308.625998:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038100608:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403308.626004:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 293 00000100:00080000:3.0:1789403308.626168:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403308.626357:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100224 00000100:00100000:3.0:1789403308.626362:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100224 00000100:00100000:3.0:1789403308.626418:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 294 00000100:00100000:3.0:1789403308.626426:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038100224:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:2.0:1789403308.628628:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403308.630975:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403308.631043:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403308.631140:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100480 00000100:00100000:2.0:1789403308.631151:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100480 00000100:00100000:2.0:1789403308.631215:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:2.0:1789403308.631225:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038100480:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403308.631295:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038100480:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403308.631302:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:1.0:1789403308.631863:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100736 00000100:00100000:1.0:1789403308.631869:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100736 00000100:00100000:1.0:1789403308.631917:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 295 00000100:00100000:1.0:1789403308.631925:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038100736:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403308.631969:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038100736:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 44us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403308.631976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 295 00000100:00080000:0.0:1789403308.632153:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403308.632158:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403308.634206:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038100224:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 7770us (10483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403308.634221:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 294 00000100:00100000:1.0:1789403308.786529:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403308.786549:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050749568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403308.786617:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403308.786767:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050749568 00000100:00100000:2.0:1789403308.786896:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050749568 00000100:00100000:2.0:1789403308.786959:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789403308.786968:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050749568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403308.787059:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789403308.787112:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050749568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403308.787119:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789403308.787176:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050749568:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789403308.787727:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403308.788200:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403308.788214:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050749696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403308.788253:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403308.788333:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050749696 00000100:00100000:1.0:1789403308.788339:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050749696 00000100:00100000:1.0:1789403308.788379:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789403308.788421:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050749696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403308.788456:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789403308.788497:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050749696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403308.788504:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789403308.790484:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050749696:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789403309.297605:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789403309.297615:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403309.297635:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789403309.297647:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789403309.297844:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403309.297862:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050749824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403309.297949:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403309.298132:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050749824 00000100:00100000:3.0:1789403309.298140:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050749824 00000100:00100000:3.0:1789403309.298196:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789403309.298205:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050749824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403309.298237:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403309.298749:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050749824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 543us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403309.298757:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789403309.299117:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050749824:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789403309.491306:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403309.555242:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789403310.024666:0:14345:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789403310.024676:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403310.024705:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789403310.024714:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789403310.295318:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403310.298326:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038100992 00000100:00100000:0.0:1789403310.298341:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038100992 00000100:00100000:2.0:1789403310.301249:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:2.0:1789403310.301265:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:11428:x1876325038100992:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403310.301283:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403310.301303:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761566 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288f0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403310.301422:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b76156d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403310.301437:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b76156d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403310.301449:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b76156d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403310.301461:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00020000:2.0:1789403310.301468:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192004097 00010000:00010000:2.0:1789403310.301567:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761566 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288f0 expref: 28 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403310.301650:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b76156d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288f0 expref: 27 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403310.301660:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:2.0:1789403310.301664:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789403310.301667:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7c00, rc 0) 00000100:00100000:2.0:1789403310.301733:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:11428:x1876325038100992:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 473us (6425us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789403310.301757:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00080000:1.0:1789403310.304406:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403310.310700:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403310.310892:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101120 00000100:00100000:1.0:1789403310.310902:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101120 00000100:00100000:1.0:1789403310.310952:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:1.0:1789403310.310961:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:11428:x1876325038101120:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1789403310.311022:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311039:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311049:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311175:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311183:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311189:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311194:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403310.311198:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311204:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311215:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:1.0:1789403310.311218:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403310.311223:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.311228:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063c00/0x5fb08b1e5b76157b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403310.311343:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:11428:x1876325038101120:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 382us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403310.311350:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:2.0:1789403310.321990:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403310.323484:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050749952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403310.323558:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403310.323741:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050749952 00000100:00100000:0.0:1789403310.323750:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050749952 00000100:00100000:0.0:1789403310.323794:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789403310.323803:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050749952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403310.323856:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789403310.323912:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050749952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403310.323919:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789403310.324027:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050749952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403310.432660:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403310.433265:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101248 00000100:00100000:1.0:1789403310.433276:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101248 00000100:00100000:1.0:1789403310.433352:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1789403310.433381:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038101248:12345-192.168.203.43@tcp:101:cat.0 00000100:00080000:0.0:1789403310.433540:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789403310.433792:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403310.433815:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b761582 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288f7 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403310.433843:0:8563:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa820aa, atime: 0x6aa820a9, ctime: 0x6aa820aa, blocks: 0x8 00010000:00010000:1.0:1789403310.433864:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1789403310.433878:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403310.433895:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b761582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288f7 expref: 7 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.433918:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b761582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288f7 expref: 7 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403310.433933:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063c00, rc 0) 00000100:00100000:1.0:1789403310.433996:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038101248:12345-192.168.203.43@tcp:101:cat.0 Request processed in 618us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403310.434003:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1789403310.438185:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403310.438374:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101376 00000100:00100000:0.0:1789403310.438384:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101376 00002000:00100000:0.0:1789403310.438478:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff90a14418c380 x1876325038101376/t0(0) o3->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:471/0 lens 488/0 e 0 to 0 dl 1789403321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789403310.438487:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a14418c380 with x1876325038101376 ext(0->4095) 00002000:00010000:0.0:1789403310.438492:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a14418c380 00000100:00100000:0.0:1789403310.438518:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1789403310.438525:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038101376:12345-192.168.203.43@tcp:3:cat.0 00000100:00100000:0.0:1789403310.438739:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038101376:12345-192.168.203.43@tcp:3:cat.0 Request processed in 213us (561us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789403310.438747:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00002000:00100000:0.0:1789403310.438754:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff90a14418c380 x1876325038101376/t0(0) o3->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:471/0 lens 488/4536 e 0 to 0 dl 1789403321 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789403310.438762:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a14418c380 with x1876325038101376 ext(0->4095) 00002000:00010000:0.0:1789403310.438766:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a14418c380 00010000:00010000:1.0:1789403310.581106:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403310.833674:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050750208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403310.834086:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403310.834156:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403310.834164:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050750080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403310.834188:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403310.834218:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750208 00000100:00100000:3.0:1789403310.834226:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750208 00000100:00100000:3.0:1789403310.834277:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750080 00000100:00100000:3.0:1789403310.834281:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750080 00000100:00100000:3.0:1789403310.834301:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789403310.834308:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050750208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403310.834343:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403310.834386:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050750208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403310.834416:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789403310.834433:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789403310.834440:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050750080:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789403310.835001:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403310.835046:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050750208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403310.835825:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403310.835842:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050750336:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.835910:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403310.835996:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050750464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836044:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403310.836089:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403310.836095:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050750592:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836118:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403310.836177:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050750720:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836201:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403310.836239:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750720 00000100:00100000:1.0:1789403310.836246:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750720 00002000:00000024:3.0:1789403310.836480:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403310.836530:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050750080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2089us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403310.836539:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789403310.836563:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789403310.836569:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750464 00000100:00100000:3.0:1789403310.836574:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750464 00000100:00100000:1.0:1789403310.836575:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050750720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403310.836606:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750592 00000100:00100000:3.0:1789403310.836609:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750592 00000100:00100000:1.0:1789403310.836620:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050750720:12345-0@lo:400:kworker.0 Request processed in 48us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403310.836629:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789403310.836633:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789403310.836643:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050750464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836656:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789403310.836665:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050750592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836701:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050750592:12345-0@lo:400:kworker.0 Request processed in 38us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403310.836706:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789403310.836745:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050750464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836767:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050750720:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836776:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050750592:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836791:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050750080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403310.836826:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403310.836833:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050750848:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836875:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403310.836918:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050750976:0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.836939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403310.837261:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050750464:12345-0@lo:400:kworker.0 Request processed in 618us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403310.837269:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789403310.837334:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750336 00000100:00100000:0.0:1789403310.837344:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750336 00000100:00100000:0.0:1789403310.837410:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789403310.837420:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050750336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403310.837459:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050750336:12345-0@lo:400:kworker.0 Request processed in 41us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403310.837465:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789403310.837553:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050751104:0@lo:400:kworker.0 00000100:00100000:0.0:1789403310.837578:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403310.837621:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751104 00000100:00100000:0.0:1789403310.837625:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751104 00000100:00100000:0.0:1789403310.837669:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789403310.837689:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050751104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403310.839368:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750848 00000100:00100000:3.0:1789403310.839382:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750848 00000100:00100000:3.0:1789403310.839435:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050750976 00000100:00100000:3.0:1789403310.839439:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050750976 00000100:00100000:3.0:1789403310.839455:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789403310.839464:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050750848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.841530:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050750336:0@lo:400:kworker.0 00000100:00080000:1.0:1789403310.841662:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403310.841668:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403310.841671:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403310.841691:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000001:00080000:2.0:1789403310.842313:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789403310.842325:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1789403310.843887:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050751360:0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.843957:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403310.844008:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751360 00000100:00100000:2.0:1789403310.844016:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751360 00000100:00100000:2.0:1789403310.845077:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789403310.845094:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050751360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.845105:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050750976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403310.845168:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050750976:12345-0@lo:400:kworker.0 Request processed in 3466us (8227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403310.845176:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050751360:12345-0@lo:400:kworker.0 Request processed in 87us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403310.845182:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789403310.845191:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789403310.845239:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050751360:0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.845286:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403310.845293:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050751488:0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.845322:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403310.845350:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751488 00000100:00100000:2.0:1789403310.845355:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751488 00000100:00100000:2.0:1789403310.845401:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789403310.845409:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050751488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.845444:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050751488:12345-0@lo:400:kworker.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403310.845462:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00080000:2.0:1789403310.845493:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a2488b1c00 x1876325050751488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403310.845503:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050751488:0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.845564:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050751232:0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.845592:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403310.845642:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751232 00000100:00100000:2.0:1789403310.845647:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751232 00000100:00100000:2.0:1789403310.845676:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789403310.845683:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050751232:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789403310.845790:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789403310.845795:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403310.845797:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403310.846069:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050751104:12345-0@lo:400:kworker.0 Request processed in 8379us (8488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403310.846079:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789403310.846111:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050751104:0@lo:400:kworker.0 00010000:00080000:1.0:1789403310.846488:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14420bb80 x1876325050750976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403310.846503:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050750976:0@lo:400:kworker.0 00000100:00100000:2.0:1789403310.846934:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050751232:12345-0@lo:400:kworker.0 Request processed in 1248us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403310.846943:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789403310.846985:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050751232:0@lo:400:kworker.0 00000100:00100000:3.0:1789403310.848005:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050750848:12345-0@lo:400:kworker.0 Request processed in 8536us (11133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403310.848032:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789403310.848183:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050750848:0@lo:400:kworker.0 00010000:00010000:1.0:1789403311.605398:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403312.626321:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789403312.886143:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1789403312.886159:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1789403312.886712:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789403312.886754:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a142149f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789403312.886760:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a281bb0900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a142149b40 00000020:00080000:1.0:1789403312.886774:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a281bb0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a143553c00 00000020:00080000:1.0:1789403312.886800:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789403312.886817:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789403312.886895:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789403312.887510:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403312.887529:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403312.887538:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403312.887545:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403312.887550:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403312.887576:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403312.887598:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a1425ebd00) 00010000:00010000:2.0:1789403312.887602:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403312.887609:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403312.887615:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7614fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403313.649507:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403313.737870:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403313.737962:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403313.738005:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403313.738034:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403313.738098:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101504 00000100:00100000:1.0:1789403313.738112:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101504 00000100:00100000:1.0:1789403313.738185:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 384 00000100:00100000:1.0:1789403313.738197:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038101504:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403313.738280:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038101504:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403313.738288:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 384 00000100:00100000:3.0:1789403313.742449:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403313.743531:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101888 00000100:00100000:0.0:1789403313.743546:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101888 00000100:00100000:0.0:1789403313.743690:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:0.0:1789403313.743704:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038101888:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403313.743802:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038101888:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 102us (5796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403313.743811:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:2.0:1789403313.744337:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101632 00000100:00100000:2.0:1789403313.744346:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101632 00000100:00100000:2.0:1789403313.744408:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038101760 00000100:00100000:2.0:1789403313.744411:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038101760 00000100:00100000:2.0:1789403313.744436:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 302 00000100:00100000:2.0:1789403313.744445:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:2387:x1876325038101632:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403313.744488:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:2387:x1876325038101632:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 46us (6645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403313.744496:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 302 00000100:00100000:2.0:1789403313.744509:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 303 00000100:00100000:2.0:1789403313.744514:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038101760:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403313.744532:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038101760:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 18us (6498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403313.744538:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 303 00000100:00100000:3.0:1789403313.747649:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403313.747690:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403313.747734:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038102016 00000100:00100000:3.0:1789403313.747746:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038102016 00000100:00100000:3.0:1789403313.747809:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1789403313.747823:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038102016:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403313.747918:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038102016:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 101us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403313.747926:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1789403313.747954:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038102144 00000100:00100000:3.0:1789403313.747958:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038102144 00000100:00100000:3.0:1789403313.747983:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038102272 00000100:00100000:3.0:1789403313.747986:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038102272 00000100:00100000:3.0:1789403313.748002:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 304 00000100:00100000:3.0:1789403313.748008:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038102144:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403313.748169:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 305 00000100:00100000:2.0:1789403313.748186:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038102272:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403313.748217:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038102272:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403313.748233:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 305 00000100:00100000:3.0:1789403313.748427:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038102144:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 418us (5992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403313.748434:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 304 00000100:00080000:1.0:1789403313.749904:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403313.749915:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403313.749918:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403313.749922:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403313.906540:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050751616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403313.906641:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403313.908763:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751616 00000100:00100000:1.0:1789403313.908782:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751616 00000100:00080000:3.0:1789403313.908874:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403313.908889:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789403313.908903:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050751616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403313.908957:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789403313.909065:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050751616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403313.909082:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789403313.909493:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050751616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403313.910721:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050751744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403313.910804:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403313.911075:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751744 00000100:00100000:3.0:1789403313.911084:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751744 00000100:00080000:2.0:1789403313.911147:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403313.911153:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789403313.911165:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050751744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403313.911190:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789403313.911264:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050751744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403313.911271:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789403313.911536:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1789403313.911545:0:3627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1789403313.911577:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050751744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403314.414725:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403314.414834:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038102400 00000100:00100000:3.0:1789403314.414856:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038102400 00000100:00100000:3.0:1789403314.414948:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:3.0:1789403314.414959:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11072:x1876325038102400:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789403314.415111:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11072:x1876325038102400:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 152us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403314.415119:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:1.0:1789403314.420316:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403314.421128:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038102528 00000100:00100000:0.0:1789403314.421141:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038102528 00000100:00100000:3.0:1789403314.421181:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050751872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403314.421212:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:0.0:1789403314.421224:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:11072:x1876325038102528:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789403314.421269:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403314.421346:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:11072:x1876325038102528:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 123us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403314.421355:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:3.0:1789403314.421373:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050751872 00000100:00100000:3.0:1789403314.421379:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050751872 00000100:00100000:3.0:1789403314.421449:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789403314.421458:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050751872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403314.422354:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403314.422808:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050751872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1007us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403314.422915:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789403314.423075:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050751872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403314.424579:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403314.424717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038102784 00000100:00100000:0.0:1789403314.424730:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038102784 00000100:00100000:0.0:1789403314.424833:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:0.0:1789403314.424856:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:11072:x1876325038102784:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789403314.425269:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:11072:x1876325038102784:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 414us (698us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789403314.425296:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00010000:00010000:1.0:1789403314.675987:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403315.442740:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403315.442771:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050752000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403315.442941:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403315.443301:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752000 00000100:00100000:3.0:1789403315.443312:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752000 00000100:00100000:3.0:1789403315.443381:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789403315.443414:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050752000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403315.443678:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789403315.443930:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050752000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 539us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403315.443939:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789403315.444680:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050752000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403315.698544:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403315.953652:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050752256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403315.953745:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403315.953772:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050752128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403315.953805:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.953991:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050752512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954028:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954048:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050753024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954069:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954086:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050753536:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954105:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954124:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789403315.954129:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050752384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954158:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954180:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050752896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954200:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954215:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050753408:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954235:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954264:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752512 00000100:00100000:1.0:1789403315.954273:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752512 00000100:00100000:3.0:1789403315.954295:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050752640:0@lo:400:kworker.0 00000100:00100000:3.0:1789403315.954318:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954318:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753024 00000100:00100000:1.0:1789403315.954320:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753024 00000100:00100000:3.0:1789403315.954328:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050753152:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954346:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753536 00000100:00100000:1.0:1789403315.954348:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753536 00000100:00100000:3.0:1789403315.954349:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954364:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752896 00000100:00100000:3.0:1789403315.954366:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1431fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050753664:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954366:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752896 00000100:00100000:1.0:1789403315.954377:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753408 00000100:00100000:1.0:1789403315.954380:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753408 00000100:00100000:3.0:1789403315.954383:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403315.954416:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789403315.954416:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752640 00000100:00100000:1.0:1789403315.954419:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752640 00000100:00100000:3.0:1789403315.954421:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050752768:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954435:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789403315.954444:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050752512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954504:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050752512:12345-0@lo:400:kworker.0 Request processed in 60us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403315.954505:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403315.954522:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050753280:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954525:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789403315.954543:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403315.954547:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789403315.954552:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050753024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954587:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050753024:12345-0@lo:400:kworker.0 Request processed in 34us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403315.954592:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789403315.954604:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789403315.954610:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a259992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050753536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954634:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a259992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050753536:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403315.954640:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789403315.954650:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789403315.954655:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050752896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954676:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050752896:12345-0@lo:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403315.954682:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789403315.954691:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789403315.954696:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050753408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954716:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050753408:12345-0@lo:400:kworker.0 Request processed in 20us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403315.954721:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789403315.954729:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789403315.954734:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050752640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954758:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050752640:12345-0@lo:400:kworker.0 Request processed in 24us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403315.954771:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789403315.954795:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752384 00000100:00100000:1.0:1789403315.954799:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752384 00000100:00100000:1.0:1789403315.954834:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789403315.954841:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050752384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954870:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050752384:12345-0@lo:400:kworker.0 Request processed in 30us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403315.954876:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789403315.954928:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a274f7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050752384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954941:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050752896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954950:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050753408:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.954959:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050752512:0@lo:400:kworker.0 00010000:00080000:1.0:1789403315.954970:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143018000 x1876325050753024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403315.954980:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050753024:0@lo:400:kworker.0 00010000:00080000:1.0:1789403315.954989:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1431ff800 x1876325050753536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403315.954997:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050753536:0@lo:400:kworker.0 00000100:00100000:1.0:1789403315.955037:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050752640:0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.959516:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752256 00000100:00100000:2.0:1789403315.959536:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752256 00000100:00100000:2.0:1789403315.959701:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752128 00000100:00100000:2.0:1789403315.959706:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752128 00000100:00100000:2.0:1789403315.959737:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789403315.959748:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050752256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403315.959789:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403315.959911:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050752256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403315.959919:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789403315.959937:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789403315.959943:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050752128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789403315.959953:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403315.959992:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050752128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (6185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403315.959998:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789403315.960044:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789403315.960052:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789403315.960080:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a250e29180, transno 4294967305 00000100:00100000:2.0:1789403315.960102:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050752128:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789403315.960324:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403315.960331:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403315.960334:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403315.960401:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050752256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403315.961783:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050752768 00000100:00100000:2.0:1789403315.961798:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050752768 00000100:00100000:2.0:1789403315.961865:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789403315.961876:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050752768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.961977:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050752768:12345-0@lo:400:kworker.0 Request processed in 103us (7470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403315.961984:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789403315.962012:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753152 00000100:00100000:2.0:1789403315.962016:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753152 00000100:00100000:2.0:1789403315.962055:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753664 00000100:00100000:2.0:1789403315.962059:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753664 00000100:00100000:2.0:1789403315.962072:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753280 00000100:00100000:2.0:1789403315.962075:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753280 00000100:00100000:2.0:1789403315.962090:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403315.962097:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050753152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.962146:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050753152:12345-0@lo:400:kworker.0 Request processed in 49us (7796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403315.962153:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789403315.962165:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789403315.962171:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1434f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050753664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.962199:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1434f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050753664:12345-0@lo:400:kworker.0 Request processed in 29us (7814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403315.962205:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789403315.962215:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789403315.962220:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050753280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.962249:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050753280:12345-0@lo:400:kworker.0 Request processed in 29us (7705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403315.962254:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789403315.962271:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403315.962308:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050752768:0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.962322:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050753280:0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.962332:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050753152:0@lo:400:kworker.0 00000100:00100000:2.0:1789403315.962343:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1431fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050753664:0@lo:400:kworker.0 00000001:02000400:0.0:1789403316.320384:0:14542:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:28:34 (1789403314) 00010000:00010000:3.0:1789403316.726923:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403317.387722:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403317.387947:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103040 00000100:00100000:1.0:1789403317.387957:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103040 00000100:00100000:1.0:1789403317.388033:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:1.0:1789403317.388061:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:12145:x1876325038103040:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403317.388086:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403317.388104:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761589 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1288fe expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388184:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388205:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388219:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388233:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388240:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388247:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388342:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76159e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388352:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76159e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.388359:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76159e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403317.388376:0:6501:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000100:00080000:2.0:1789403317.389277:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789403317.409960:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789403317.410088:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410099:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410108:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410114:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403317.410119:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410127:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410143:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a243d8b400) 00010000:00010000:1.0:1789403317.410146:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403317.410150:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410157:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761590 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410170:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410177:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410201:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410207:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403317.410210:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410216:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410225:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a142628800) 00010000:00010000:1.0:1789403317.410228:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403317.410231:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410236:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b761597 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410566:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761589 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288fe expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410582:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76159e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288fe expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403317.410590:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:1.0:1789403317.410592:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403317.410595:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063400, rc 0) 00000100:00100000:1.0:1789403317.410666:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:12145:x1876325038103040:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 22607us (22952us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789403317.410685:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:2.0:1789403317.424949:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403317.425028:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103168 00000100:00100000:3.0:1789403317.425038:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103168 00000100:00100000:3.0:1789403317.425125:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1789403317.425135:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a604050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:2389:x1876325038103168:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403317.425150:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403317.425173:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76159e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288fe expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403317.425197:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:3.0:1789403317.425203:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403317.425265:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a604050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:2389:x1876325038103168:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403317.425450:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1789403317.438087:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403317.440683:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103296 00000100:00100000:1.0:1789403317.440698:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103296 00000100:00100000:1.0:1789403317.440765:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:1.0:1789403317.440776:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:12145:x1876325038103296:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789403317.441166:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:12145:x1876325038103296:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 391us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403317.441175:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:0.0:1789403317.457875:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403317.458482:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103424 00000100:00100000:1.0:1789403317.458492:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103424 00000100:00100000:1.0:1789403317.458558:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 151 00000100:00080000:0.0:1789403317.458566:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403317.458573:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:12145:x1876325038103424:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789403317.458852:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:12145:x1876325038103424:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 283us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403317.458860:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 151 00000040:00080000:2.0:1789403317.489747:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403317.489756:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403317.490249:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789403317.490260:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789403317.682340:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403317.745558:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403318.772868:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403318.858410:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858463:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858489:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858517:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858539:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858562:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858585:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403318.858621:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103808 00000100:00100000:2.0:1789403318.858634:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103808 00000100:00100000:2.0:1789403318.858692:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103680 00000100:00100000:2.0:1789403318.858695:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103680 00000100:00100000:2.0:1789403318.858705:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104192 00000100:00100000:2.0:1789403318.858706:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104192 00000100:00100000:2.0:1789403318.858723:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104320 00000100:00100000:2.0:1789403318.858725:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104320 00000100:00100000:2.0:1789403318.858741:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 312 00000100:00100000:2.0:1789403318.858751:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038103808:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403318.858849:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038103808:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403318.858857:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 312 00000100:00100000:2.0:1789403318.858879:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 313 00000100:00100000:2.0:1789403318.858885:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:2388:x1876325038103680:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403318.859422:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103552 00000100:00100000:3.0:1789403318.859431:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103552 00000100:00100000:0.0:1789403318.862646:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 314 00000100:00100000:0.0:1789403318.862677:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038104192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403318.862785:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038104192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 122us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403318.862794:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 314 00000100:00100000:0.0:1789403318.862852:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 315 00000100:00100000:0.0:1789403318.862861:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038104320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403318.862889:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038104320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403318.862896:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 315 00000100:00080000:0.0:1789403318.864251:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403318.864262:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403318.866155:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 386 00000100:00100000:3.0:1789403318.866183:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038103552:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403318.866295:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038103552:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 125us (7926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403318.866304:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 386 00000100:00100000:3.0:1789403318.868592:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038103936 00000100:00100000:3.0:1789403318.868611:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038103936 00000100:00100000:3.0:1789403318.868693:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104064 00000100:00100000:3.0:1789403318.868697:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104064 00000100:00100000:3.0:1789403318.868726:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1789403318.868736:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038103936:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403318.868825:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038103936:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 91us (10312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403318.868851:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1789403318.868870:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:3.0:1789403318.868876:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038104064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403318.868900:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038104064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (10338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403318.868905:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00080000:1.0:1789403318.869082:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403318.869087:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403318.875893:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:2388:x1876325038103680:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403318.875923:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 313 00000100:00100000:2.0:1789403319.026863:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403319.026893:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050753792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403319.026990:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403319.027446:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753792 00000100:00100000:2.0:1789403319.027457:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753792 00000100:00100000:2.0:1789403319.027531:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789403319.027541:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050753792:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789403319.027575:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789403319.027580:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789403319.027648:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050753792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403319.027656:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789403319.027888:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050753792:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789403319.031443:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789403319.031467:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:2.0:1789403319.031479:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:0.0:1789403319.031498:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789403319.031505:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050753920:0@lo:13:osp-pre-0-1.0 00000020:00080000:0.0:1789403319.031573:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789403319.031587:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403319.031688:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050753920 00000100:00100000:0.0:1789403319.031698:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050753920 00000100:00100000:0.0:1789403319.031775:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789403319.031786:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050753920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403319.031825:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789403319.031888:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050753920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403319.031895:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1789403319.032084:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403319.032172:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050753920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403319.037845:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.037958:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104448 00000100:00100000:2.0:1789403319.037971:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104448 00000100:00100000:2.0:1789403319.038058:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:2.0:1789403319.038073:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:12187:x1876325038104448:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403319.038101:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403319.038126:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7615ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128905 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038203:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038219:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038234:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038256:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038263:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038269:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038314:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038320:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038326:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038332:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403319.038337:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038346:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038358:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403319.038361:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403319.038366:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038373:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7615b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038416:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038423:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038429:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038434:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403319.038437:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038442:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038451:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a141a01000) 00010000:00010000:2.0:1789403319.038454:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403319.038458:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038465:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7615ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038506:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7615ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128905 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038518:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403319.038521:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403319.038531:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7615ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128905 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.038544:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6e00, rc 0) 00000100:00100000:2.0:1789403319.038621:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:12187:x1876325038104448:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 553us (792us total) trans 0 rc 301/301 00000100:00100000:2.0:1789403319.038629:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00080000:3.0:1789403319.038936:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403319.053703:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.053793:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104704 00000100:00100000:1.0:1789403319.053816:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104704 00000100:00100000:1.0:1789403319.053884:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:1.0:1789403319.053895:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:12187:x1876325038104704:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:1.0:1789403319.053966:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403319.054002:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b760f0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128730 expref: 13 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054026:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403319.054051:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403319.054134:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054148:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054160:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054174:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054180:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054187:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054948:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054963:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.054972:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403319.054990:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000347b88b6 reply state 000000004486912c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055002:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055019:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403319.055022:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403319.055025:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789403319.055032:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789403319.055040:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055048:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055055:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055062:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403319.055067:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055076:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055085:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:1.0:1789403319.055088:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403319.055092:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055098:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403319.055114:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000347b88b6 reply state 000000004486912c transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055132:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.055138:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a142628000) 00010000:00010000:1.0:1789403319.055141:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403319.055142:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789403319.055249:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:12187:x1876325038104704:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 1354us (1553us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789403319.055258:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 153 00000100:00100000:2.0:1789403319.130825:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.130885:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104832 00000100:00100000:1.0:1789403319.130899:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104832 00000100:00100000:1.0:1789403319.130977:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 154 00000100:00100000:1.0:1789403319.130990:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+14:12195:x1876325038104832:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:1.0:1789403319.131024:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403319.131054:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12890c expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.131141:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7615dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.131159:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7615dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.131175:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7615dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403319.131229:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403319.131234:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403319.131277:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7615dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.131308:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12890c expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.131327:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7615dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12890c expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.131335:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:1.0:1789403319.131339:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403319.131343:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062800, rc 0) 00000100:00100000:1.0:1789403319.131456:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:12195:x1876325038104832:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 467us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403319.131464:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 154 00000100:00100000:1.0:1789403319.219435:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.219486:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038104960 00000100:00100000:1.0:1789403319.219500:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038104960 00000100:00100000:1.0:1789403319.219568:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00100000:1.0:1789403319.219581:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+15:12201:x1876325038104960:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403319.219608:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403319.219637:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128913 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.219722:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.219741:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.219772:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.219787:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.219794:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222254:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222457:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7615f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222472:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7615f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222482:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7615f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403319.222531:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789403319.222536:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403319.222562:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7615f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222575:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222581:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222603:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222609:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403319.222613:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222621:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222634:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:1.0:1789403319.222637:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403319.222642:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222649:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7615eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222661:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222666:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222671:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222675:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403319.222677:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222693:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222701:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a142628000) 00010000:00010000:1.0:1789403319.222703:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403319.222707:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222713:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7615f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222750:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b7615e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128913 expref: 17 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222765:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7615f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128913 expref: 16 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.222772:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403319.222774:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789403319.222776:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063600, rc 0) 00000100:00100000:1.0:1789403319.225052:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:12201:x1876325038104960:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5457us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403319.225068:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 155 00000100:00100000:0.0:1789403319.231501:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.231614:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038105216 00000100:00100000:1.0:1789403319.231633:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038105216 00000100:00100000:1.0:1789403319.231700:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 156 00000100:00100000:1.0:1789403319.231712:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+16:12201:x1876325038105216:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403319.231750:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403319.231779:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761600 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12891a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.233418:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.233445:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.233460:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.233677:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.233703:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.233718:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403319.234254:0:6500:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789403319.234468:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.234479:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.234487:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403319.234511:0:6500:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:1.0:1789403319.234524:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:1.0:1789403319.254967:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.254985:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.254992:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.254999:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403319.255004:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.255013:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.255032:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403319.255036:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403319.255041:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.255048:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761607 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403319.255063:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c2b587f reply state 00000000c62e8aab transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.255077:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.255107:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:1.0:1789403319.255110:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403319.255114:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789403319.255164:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761600 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.256600:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.256618:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:1.0:1789403319.256622:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403319.256625:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04e00, rc 0) 00000100:00100000:1.0:1789403319.256719:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12201:x1876325038105216:12345-192.168.203.43@tcp:101:bash.0 Request processed in 25008us (25228us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789403319.256730:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 156 00000100:00100000:1.0:1789403319.320154:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403319.323631:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038105344 00000100:00100000:3.0:1789403319.323648:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038105344 00000100:00100000:2.0:1789403319.323883:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1789403319.323901:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038105344:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403319.323928:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403319.323956:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128921 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403319.323994:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403319.324022:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1789403319.324027:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403319.324038:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 6 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.324074:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 6 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.324090:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6600, rc 0) 00000100:00100000:2.0:1789403319.324182:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2388:x1876325038105344:12345-192.168.203.43@tcp:101:bash.0 Request processed in 285us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403319.324211:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1789403319.332521:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403319.332625:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038105472 00000100:00100000:3.0:1789403319.332639:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038105472 00000100:00100000:3.0:1789403319.332716:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1789403319.332728:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:12201:x1876325038105472:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403319.332753:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403319.332778:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128928 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.332831:0:8563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.332841:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403319.332847:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403319.332853:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 7 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.332915:0:8563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.332930:0:8563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403319.332947:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8563:1876325050754048:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403319.333278:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605000 going to sleep for 11 seconds 00000100:00100000:3.0:1789403319.351625:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8563:1876325050754048:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403319.351679:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 7 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.351707:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185000, rc 0) 00000100:00100000:3.0:1789403319.351786:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:12201:x1876325038105472:12345-192.168.203.43@tcp:101:bash.0 Request processed in 19060us (19279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403319.351797:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1789403319.355920:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.356023:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038105600 00000100:00100000:2.0:1789403319.356035:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038105600 00010000:00010000:2.0:1789403319.356086:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.356135:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1789403319.356147:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038105600:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403319.356165:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403319.356196:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.356213:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.356245:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7da267/0x5fb08b1e5b761623 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128921 expref: 7 pid: 8416 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.356267:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403319.356271:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403319.356281:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 6 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.356292:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 6 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.356375:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 6 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.356453:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6485:1876325050754176:192.168.203.43@tcp:105: 00000100:00100000:2.0:1789403319.356563:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403319.362606:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.362714:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038105856 00000100:00100000:1.0:1789403319.362727:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038105856 00000100:00100000:1.0:1789403319.362807:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1789403319.362819:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12201:x1876325038105856:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1789403319.363209:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:12201:x1876325038105856:12345-192.168.203.43@tcp:35:bash.0 Request processed in 390us (614us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789403319.363217:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:0.0:1789403319.363358:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6485:1876325050754176:192.168.203.43@tcp:105: 00010000:00010000:0.0:1789403319.363433:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403319.363471:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038105600:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 7327us (7565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403319.363480:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:1.0:1789403319.367997:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.368065:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.368197:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038106112 00000100:00100000:2.0:1789403319.368211:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038106112 00000100:00100000:2.0:1789403319.368279:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1789403319.368291:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038106112:12345-192.168.203.43@tcp:16:kworker.0 00000100:00100000:2.0:1789403319.368495:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038106112:12345-192.168.203.43@tcp:16:kworker.0 Request processed in 205us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403319.368505:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1789403319.368591:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038105984 00000100:00100000:0.0:1789403319.368596:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038105984 00002000:00100000:0.0:1789403319.368632:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90a250e2ad80 x1876325038105984/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:480/0 lens 504/0 e 0 to 0 dl 1789403330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789403319.368644:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a250e2ad80 with x1876325038105984 ext(0->12) 00002000:00010000:0.0:1789403319.368659:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a250e2ad80 00000100:00100000:0.0:1789403319.368691:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1789403319.368698:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2387:x1876325038105984:12345-192.168.203.43@tcp:4:bash.0 00000100:00100000:3.0:1789403319.370928:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2387:x1876325038105984:12345-192.168.203.43@tcp:4:bash.0 Request processed in 2217us (2936us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789403319.370944:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00002000:00100000:3.0:1789403319.370958:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90a250e2ad80 x1876325038105984/t4294967306(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:480/0 lens 504/448 e 0 to 0 dl 1789403330 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789403319.370969:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a250e2ad80 with x1876325038105984 ext(0->12) 00002000:00010000:3.0:1789403319.370977:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a250e2ad80 00000100:00100000:1.0:1789403319.523533:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.525542:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038106368 00000100:00100000:2.0:1789403319.525556:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038106368 00000100:00100000:2.0:1789403319.525678:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:2.0:1789403319.525689:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:12211:x1876325038106368:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403319.525713:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403319.525732:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12892f expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403319.525843:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789403319.525948:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761631 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12892f expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.525983:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:2.0:1789403319.525986:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403319.525992:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12892f expref: 22 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.526018:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7600, rc 0) 00000100:00100000:2.0:1789403319.526094:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12211:x1876325038106368:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 406us (2571us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789403319.526101:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 157 00000100:00100000:2.0:1789403319.534695:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.534856:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038106624 00000100:00100000:1.0:1789403319.534866:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038106624 00000100:00100000:1.0:1789403319.534978:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:1.0:1789403319.534989:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12211:x1876325038106624:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403319.535376:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:12211:x1876325038106624:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 386us (1090us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789403319.535384:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1789403319.537946:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403319.537969:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050754304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403319.538035:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789403319.538346:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403319.538351:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403319.538466:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789403319.538473:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789403319.538676:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050754304 00000100:00100000:3.0:1789403319.538684:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050754304 00000100:00100000:3.0:1789403319.538785:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789403319.538796:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050754304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403319.538838:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403319.538895:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050754304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403319.538902:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789403319.538972:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050754304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403319.638517:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.638784:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038106752 00000100:00100000:1.0:1789403319.638795:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038106752 00000100:00100000:1.0:1789403319.638873:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 158 00000100:00100000:1.0:1789403319.638884:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:12217:x1876325038106752:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403319.638919:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403319.638940:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76163f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128936 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.639030:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761646 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.639045:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.639057:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403319.639101:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789403319.639105:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403319.639127:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.639182:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76163f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128936 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.639200:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128936 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.639208:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403319.639211:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403319.639214:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05000, rc 0) 00000100:00100000:1.0:1789403319.639284:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:12217:x1876325038106752:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 401us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403319.639291:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 158 00000100:00100000:0.0:1789403319.671224:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.675554:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038107008 00000100:00100000:1.0:1789403319.675570:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038107008 00000100:00100000:1.0:1789403319.675665:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:1.0:1789403319.675676:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:12217:x1876325038107008:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403319.675695:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403319.675714:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76164d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12893d expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.675834:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.675849:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.675872:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403319.675900:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000004:00020000:1.0:1789403319.675911:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:1.0:1789403319.676008:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76164d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12893d expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.676027:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12893d expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.676036:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:1.0:1789403319.676039:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403319.676042:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04400, rc 0) 00000100:00100000:1.0:1789403319.676111:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:12217:x1876325038107008:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 437us (4896us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789403319.676118:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:2.0:1789403319.682166:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403319.682376:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038107392 00000100:00100000:0.0:1789403319.682407:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038107392 00000100:00100000:0.0:1789403319.682477:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1789403319.682488:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:2387:x1876325038107392:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403319.682502:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403319.682537:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12893d expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.682557:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:0.0:1789403319.682563:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403319.682635:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:2387:x1876325038107392:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 149us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403319.682643:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1789403319.685791:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.685888:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038107264 00000100:00100000:2.0:1789403319.685900:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038107264 00000100:00100000:2.0:1789403319.685967:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:2.0:1789403319.685977:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:12217:x1876325038107264:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403319.686007:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403319.686027:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761662 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128944 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.686131:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761669 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.686165:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761669 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.686177:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761669 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403319.686191:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000004:00020000:2.0:1789403319.686200:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:2.0:1789403319.686287:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761662 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128944 expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.686306:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761669 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128944 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.686315:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:2.0:1789403319.686319:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789403319.686322:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6a00, rc 0) 00000100:00100000:2.0:1789403319.686410:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:12217:x1876325038107264:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 412us (605us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789403319.686418:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:1.0:1789403319.697120:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.697213:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038107520 00000100:00100000:2.0:1789403319.697223:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038107520 00000100:00100000:2.0:1789403319.697284:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1789403319.697294:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2387:x1876325038107520:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:2.0:1789403319.697340:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.697361:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 8 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.697386:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403319.697426:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403319.697432:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.697471:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 8 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.697486:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 8 pid: 8563 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.697502:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8415:1876325050754432:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403319.697596:0:8415:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403319.702233:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403319.702304:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038107648 00000100:00100000:0.0:1789403319.702314:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038107648 00010000:00010000:0.0:1789403319.702353:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 9 pid: 8563 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.702356:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8415:1876325050754432:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403319.702383:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403319.702459:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1789403319.702471:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2389:x1876325038107648:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403319.702486:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789403319.702505:0:6487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789403319.702508:0:6487:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789403319 00002000:00010000:0.0:1789403319.702510:0:6487:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789403319 00002000:00010000:0.0:1789403319.702512:0:6487:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789403319.702518:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 9 pid: 8563 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.702530:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 9 pid: 8563 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.702552:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b76162a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128928 expref: 9 pid: 8563 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.702568:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403319.702572:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403319.702577:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.702586:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.702662:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403319.702714:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038107648:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 246us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403319.702722:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00010000:00010000:2.0:1789403319.702867:0:8415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703655:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703689:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703710:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703719:0:8415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703727:0:8415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403319.703732:0:8415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703743:0:8415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703759:0:8415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.703767:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005817be66/0x5fb08b1e5b761677 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.703851:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038107520:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 6557us (6738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403319.703860:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:3.0:1789403319.709320:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403319.709424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038107904 00000100:00100000:0.0:1789403319.709435:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038107904 00000100:00100000:0.0:1789403319.709489:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:0.0:1789403319.709501:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:12217:x1876325038107904:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:0.0:1789403319.709559:0:6503:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761669 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128944 expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403319.709784:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789403319.709831:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789403319.710898:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789403319.710950:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.710970:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.710991:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.711031:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 30 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.711049:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 30 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403319.711065:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6503:1876325050754560:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403319.711173:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504540 going to sleep for 11 seconds 00000100:00100000:1.0:1789403319.714634:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403319.714793:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6503:1876325050754560:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403319.714832:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.715267:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038108032 00000100:00100000:2.0:1789403319.715276:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038108032 00010000:00010000:2.0:1789403319.715626:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 31 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403319.715676:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:2.0:1789403319.715686:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+31:2389:x1876325038108032:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403319.715889:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403319.715899:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 31 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.716237:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 31 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.716262:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761615 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12891a expref: 31 pid: 6500 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.716279:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:2.0:1789403319.716285:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.721095:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.721104:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403319.721164:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403319.721243:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:2389:x1876325038108032:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5554us (6613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403319.721254:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00010000:00010000:3.0:1789403319.721630:0:6503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.721640:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789403319.721764:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789403319.721899:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789403319.721997:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6503:1876325050754688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789403319.722050:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403319.722085:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605780 going to sleep for 11 seconds 00000100:00100000:1.0:1789403319.722330:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050754688 00000100:00100000:1.0:1789403319.722338:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050754688 00000100:00100000:1.0:1789403319.722416:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789403319.722426:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6503:x1876325050754688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789403319.722506:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6503:x1876325050754688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403319.722513:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1789403319.722716:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403319.722750:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6503:1876325050754688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789403319.722879:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789403319.722926:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6503:1876325050754816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789403319.722954:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403319.723671:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605840 going to sleep for 11 seconds 00000100:00100000:2.0:1789403319.723794:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050754816 00000100:00100000:2.0:1789403319.723819:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050754816 00000100:00100000:2.0:1789403319.723863:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789403319.723870:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6503:x1876325050754816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789403319.724013:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6503:x1876325050754816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 142us (1057us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789403319.724020:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789403319.724164:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6503:1876325050754816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789403319.724207:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789403319.724240:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.724249:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.724257:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.724262:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.724266:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.724273:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.724286:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:3.0:1789403319.724289:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789403319.724293:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.724299:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76167e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789403319.724382:0:6503:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789403319.724641:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789403319.724654:0:6503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365723264587ns, next at 366723261379ns, rc = 0 00000001:00080000:3.0:1789403319.724661:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789403319.724693:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a142628300) 00010000:00010000:3.0:1789403319.724696:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789403319.724702:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761669 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128944 expref: 34 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403319.724792:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:12217:x1876325038107904:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 15293us (15483us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789403319.724814:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000020:00080000:3.0:1789403319.724819:0:6503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789403319.728445:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403319.729679:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038108160 00000100:00100000:0.0:1789403319.729691:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038108160 00000100:00100000:0.0:1789403319.729735:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:0.0:1789403319.729742:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+33:12217:x1876325038108160:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403319.729761:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403319.729778:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761685 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12894b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.729861:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761685 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12894b expref: 34 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.729877:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761685 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12894b expref: 34 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403319.729895:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403319.729899:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789403319.729902:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8000, rc 0) 00000100:00100000:0.0:1789403319.729965:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:12217:x1876325038108160:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 222us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403319.729973:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000040:00080000:3.0:1789403319.730862:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789403319.741564:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403319.742901:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038108416 00000100:00100000:3.0:1789403319.742914:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038108416 00000100:00100000:3.0:1789403319.742986:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1789403319.742996:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:12217:x1876325038108416:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403319.743228:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:12217:x1876325038108416:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 234us (1674us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789403319.743236:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00010000:00010000:1.0:1789403319.793693:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403319.846318:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.846653:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038108672 00000100:00100000:1.0:1789403319.846663:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038108672 00000100:00100000:1.0:1789403319.846759:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:1.0:1789403319.846770:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:12227:x1876325038108672:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403319.846803:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403319.846826:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76168c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128952 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403319.846926:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789403319.848115:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76168c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128952 expref: 37 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.848133:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:1.0:1789403319.848136:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403319.848141:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76168c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128952 expref: 37 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403319.848157:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04c00, rc 0) 00000100:00100000:1.0:1789403319.848234:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:12227:x1876325038108672:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1465us (1924us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1789403319.848242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 162 00000100:00100000:3.0:1789403319.854940:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403319.866334:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038108800 00000100:00100000:2.0:1789403319.866355:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038108800 00000100:00100000:3.0:1789403319.866910:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:3.0:1789403319.866922:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:12227:x1876325038108800:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1789403319.867011:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867039:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867053:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867086:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867094:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867101:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867178:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867187:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867194:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403319.867244:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867257:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867263:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867270:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867276:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.867281:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867295:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867308:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403319.867310:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403319.867315:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867322:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76169a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867336:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867342:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867348:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867353:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.867355:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867361:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867367:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:3.0:1789403319.867370:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403319.867372:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867422:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867434:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867441:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867447:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867452:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.867455:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867460:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867468:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403319.867470:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403319.867473:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.867479:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403319.867572:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:12227:x1876325038108800:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 651us (12648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403319.867581:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:1.0:1789403319.875336:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403319.875417:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038109056 00000100:00100000:3.0:1789403319.875427:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038109056 00000100:00100000:3.0:1789403319.875479:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:3.0:1789403319.875490:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+36:12227:x1876325038109056:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403319.875705:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:12227:x1876325038109056:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 217us (379us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789403319.875713:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1789403319.967100:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403319.974725:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038109312 00000100:00100000:1.0:1789403319.974743:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038109312 00000100:00100000:3.0:1789403319.976428:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:3.0:1789403319.976443:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:12230:x1876325038109312:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403319.976468:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403319.976490:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128959 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976575:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976590:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976602:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976613:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976619:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976626:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976750:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976758:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976766:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403319.976773:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:3.0:1789403319.976777:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000004:00020000:3.0:1789403319.976785:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:3.0:1789403319.976869:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976877:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976883:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976889:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.976893:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976900:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976911:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403319.976914:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403319.976918:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976931:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b7616b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976946:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976952:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976957:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976962:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.976965:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976971:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976978:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:3.0:1789403319.976980:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403319.976983:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.976988:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7616bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.977267:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 40 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.977283:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 39 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.977296:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403319.977299:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403319.977301:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185c00, rc 0) 00000100:00100000:3.0:1789403319.977365:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:12230:x1876325038109312:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 926us (10275us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789403319.977373:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 164 00000100:00100000:2.0:1789403319.986740:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403319.986935:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038109440 00000100:00100000:3.0:1789403319.986945:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038109440 00000100:00100000:3.0:1789403319.987022:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1789403319.987034:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:12230:x1876325038109440:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1789403319.987098:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987124:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987137:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987174:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987182:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987189:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987195:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403319.987214:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987222:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987234:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403319.987238:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403319.987243:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403319.987249:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7616d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403319.987335:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:12230:x1876325038109440:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 303us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403319.987343:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:1.0:1789403320.008737:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403320.009431:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038109696 00000100:00100000:3.0:1789403320.009441:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038109696 00000100:00100000:3.0:1789403320.009506:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:3.0:1789403320.009519:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:12230:x1876325038109696:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403320.009772:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+40:12230:x1876325038109696:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 255us (1044us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789403320.009780:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:0.0:1789403320.350373:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.350522:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038109952 00000100:00100000:1.0:1789403320.350533:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038109952 00000100:00100000:1.0:1789403320.350596:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:1.0:1789403320.350607:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+40:12261:x1876325038109952:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:1.0:1789403320.350649:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403320.350674:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7616d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128960 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.350820:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7616e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.350833:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7616e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.350847:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7616e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403320.350858:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000004:00020000:1.0:1789403320.350867:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:1.0:1789403320.350964:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7616d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128960 expref: 43 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.350984:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7616e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128960 expref: 42 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.350992:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.350994:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403320.350998:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04800, rc 0) 00000100:00100000:1.0:1789403320.351478:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12261:x1876325038109952:12345-192.168.203.43@tcp:101:cat.0 Request processed in 872us (1114us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789403320.351488:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 166 00000100:00100000:2.0:1789403320.358041:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403320.358158:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403320.358331:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038110336 00000100:00100000:0.0:1789403320.358362:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038110336 00000100:00100000:0.0:1789403320.358455:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:0.0:1789403320.358465:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:2387:x1876325038110336:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403320.358481:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403320.358504:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7616e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128960 expref: 42 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403320.358523:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403320.358528:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403320.358583:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+41:2387:x1876325038110336:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 119us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403320.358590:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1789403320.358991:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038110208 00000100:00100000:3.0:1789403320.359002:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038110208 00000100:00100000:3.0:1789403320.359064:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:3.0:1789403320.359074:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+41:12261:x1876325038110208:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1789403320.359560:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12261:x1876325038110208:12345-192.168.203.43@tcp:35:cat.0 Request processed in 485us (1532us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789403320.359583:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1789403320.417424:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.417813:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038110592 00000100:00100000:1.0:1789403320.417827:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038110592 00000100:00100000:1.0:1789403320.417971:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1789403320.417984:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12267:x1876325038110592:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:1.0:1789403320.418018:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403320.418022:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789403320.418057:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761646 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128936 expref: 42 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.418091:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403320.418097:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403320.418114:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7616ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128967 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.418251:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.418269:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 42 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.418278:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.418319:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 42 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.418335:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 42 pid: 9061 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403320.418351:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050754944:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403320.418547:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789403320.426089:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.426869:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050754944:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403320.426911:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403320.427158:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038110720 00000100:00100000:3.0:1789403320.427167:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038110720 00010000:00010000:3.0:1789403320.427222:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 43 pid: 9061 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403320.427306:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:3.0:1789403320.427319:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:2389:x1876325038110720:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403320.427341:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403320.427349:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 43 pid: 9061 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403320.427362:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 43 pid: 9061 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403320.427415:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b7616c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128959 expref: 43 pid: 9061 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403320.427434:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403320.427440:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403320.427452:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403320.427460:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403320.427520:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403320.427594:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:2389:x1876325038110720:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 277us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403320.427613:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00010000:00010000:1.0:1789403320.429587:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.429620:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403320.429649:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000004:00020000:1.0:1789403320.429675:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789403320.429874:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7616ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 43 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.429900:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 42 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.429910:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.429913:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403320.429918:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04e00, rc 0) 00000100:00100000:1.0:1789403320.430026:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12267:x1876325038110592:12345-192.168.203.43@tcp:101:dd.0 Request processed in 12042us (12647us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789403320.430036:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:2.0:1789403320.434856:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.434959:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038110848 00000100:00100000:1.0:1789403320.434973:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038110848 00000100:00100000:1.0:1789403320.440206:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:1.0:1789403320.440240:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12267:x1876325038110848:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:1.0:1789403320.440299:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403320.440331:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761703 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12896e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.440381:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.440417:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.440432:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.440943:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761703 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 44 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.440967:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 43 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.441139:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.441144:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403320.441149:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04800, rc 0) 00000100:00100000:1.0:1789403320.441291:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:12267:x1876325038110848:12345-192.168.203.43@tcp:101:dd.0 Request processed in 1067us (6448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403320.441301:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 168 00000100:00100000:2.0:1789403320.445786:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.445904:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038111104 00000100:00100000:1.0:1789403320.445918:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038111104 00000100:00100000:1.0:1789403320.446166:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:1.0:1789403320.446181:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:12267:x1876325038111104:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:1.0:1789403320.452922:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.452956:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.452971:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403320.453171:0:13788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789403320.453201:0:13788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000e8f0ba reply state 0000000072b012ca transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.453216:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.453225:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.453228:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403320.453235:0:13788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403320.453448:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+46:12267:x1876325038111104:12345-192.168.203.43@tcp:36:dd.0 Request processed in 7263us (7671us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789403320.453459:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00000020:00080000:1.0:1789403320.453469:0:13788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789403320.563933:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050755072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403320.564039:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403320.568181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755072 00000100:00100000:1.0:1789403320.568205:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755072 00000100:00100000:1.0:1789403320.568345:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789403320.568359:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050755072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403320.568440:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789403320.568575:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050755072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 219us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403320.568603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789403320.568710:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050755072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403320.738202:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.739477:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038111232 00000100:00100000:1.0:1789403320.739497:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038111232 00000100:00100000:1.0:1789403320.739606:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:1.0:1789403320.739622:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+46:12281:x1876325038111232:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:1.0:1789403320.739658:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403320.739687:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761718 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128975 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739776:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739804:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739818:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739833:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739841:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739847:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739939:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739950:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.739979:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.740028:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.740045:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 47 pid: 6499 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403320.740063:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050755200:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403320.740719:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789403320.753140:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050755200:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403320.753197:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403320.759115:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.760240:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038111488 00000100:00100000:1.0:1789403320.760259:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038111488 00000100:00100000:1.0:1789403320.760356:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1789403320.760368:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+48:6159:x1876325038111488:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789403320.761064:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:6159:x1876325038111488:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 695us (1962us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789403320.761197:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1789403320.769855:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403320.770366:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038111616 00000100:00100000:2.0:1789403320.770535:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038111616 00010000:00010000:2.0:1789403320.770765:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 49 pid: 6499 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403320.770876:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1789403320.770889:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a604450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:2387:x1876325038111616:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403320.770927:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403320.770936:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 49 pid: 6499 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403320.770952:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 49 pid: 6499 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403320.770978:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7616f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128967 expref: 49 pid: 6499 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403320.770999:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:2.0:1789403320.771005:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403320.771016:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403320.771025:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403320.771070:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403320.771159:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a604450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+48:2387:x1876325038111616:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 273us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403320.771179:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00010000:00010000:1.0:1789403320.771309:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771320:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403320.771441:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789403320.771447:0:6499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403320.771476:0:6499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771491:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771501:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771508:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771514:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771520:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403320.771525:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771532:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771543:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403320.771546:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403320.771550:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771557:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76171f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771581:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771597:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771603:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771609:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403320.771612:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771619:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771628:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:1.0:1789403320.771630:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403320.771633:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771639:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761726 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771679:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761718 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128975 expref: 48 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771695:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128975 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.771732:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.771735:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403320.771738:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:1.0:1789403320.771772:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:12281:x1876325038111232:12345-192.168.203.43@tcp:101:stat.0 Request processed in 32154us (33593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403320.771780:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00010000:00010000:3.0:1789403320.818525:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403320.875369:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403320.877171:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038111872 00000100:00100000:1.0:1789403320.877192:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038111872 00000100:00100000:1.0:1789403320.877289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 171 00000100:00100000:1.0:1789403320.877302:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:12287:x1876325038111872:12345-192.168.203.43@tcp:36:truncate.0 00010000:00010000:1.0:1789403320.877451:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403320.877487:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76172d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128975 expref: 47 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.877513:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.877520:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403320.877772:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.879925:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.879961:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403320.880090:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1789403320.880161:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc17255c reply state 00000000e53d9edc transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.880195:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403320.880204:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403320.880207:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403320.880212:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403320.880383:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:12287:x1876325038111872:12345-192.168.203.43@tcp:36:truncate.0 Request processed in 3079us (5023us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789403320.880427:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 171 00000020:00080000:1.0:1789403320.880435:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789403321.051648:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403321.051816:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038112000 00000100:00100000:1.0:1789403321.051829:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038112000 00000100:00100000:1.0:1789403321.051934:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00100000:1.0:1789403321.051947:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+49:12301:x1876325038112000:12345-192.168.203.43@tcp:101:stat.0 00010000:00010000:1.0:1789403321.052098:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403321.052126:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76173b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12897c expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052218:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052234:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052250:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052262:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052292:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052299:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052385:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052433:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052441:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403321.052496:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789403321.052502:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403321.052527:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052542:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052552:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052560:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052566:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052813:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403321.052818:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052827:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052841:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403321.052844:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403321.052850:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052856:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761742 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052871:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052877:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052883:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052888:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403321.052890:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052896:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052916:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:1.0:1789403321.052918:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403321.052921:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052927:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.052965:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76173b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 51 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.053187:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 50 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.053195:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403321.053198:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403321.053200:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063a00, rc 0) 00000100:00100000:1.0:1789403321.053321:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+50:12301:x1876325038112000:12345-192.168.203.43@tcp:101:stat.0 Request processed in 1376us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403321.053331:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 172 00000100:00080000:3.0:1789403321.053427:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789403321.073928:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367072535314ns, next at 368072532098ns, rc = 0 00000100:00100000:2.0:1789403321.074131:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403321.074161:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050755328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403321.074252:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.074805:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050755584:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.074850:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.074872:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050756096:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.074894:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.074910:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050756608:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.074931:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.074955:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789403321.074961:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050755456:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075009:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.075034:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050755968:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075062:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.075092:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050756480:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403321.075159:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755456 00000100:00100000:0.0:1789403321.075169:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755456 00000100:00100000:0.0:1789403321.075220:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789403321.075230:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075289:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050755456:12345-0@lo:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.075297:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789403321.075351:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755968 00000100:00100000:0.0:1789403321.075355:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755968 00000100:00100000:0.0:1789403321.075379:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789403321.075410:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050755968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075448:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050755968:12345-0@lo:400:kworker.0 Request processed in 62us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.075454:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789403321.075493:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050755456:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075506:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050755968:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075553:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755584 00000100:00100000:0.0:1789403321.075557:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755584 00000100:00100000:0.0:1789403321.075584:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756096 00000100:00100000:0.0:1789403321.075587:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756096 00000100:00100000:0.0:1789403321.075612:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756608 00000100:00100000:0.0:1789403321.075615:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756608 00000100:00100000:0.0:1789403321.075633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789403321.075639:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050755584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075676:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050755584:12345-0@lo:400:kworker.0 Request processed in 37us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.075690:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789403321.075716:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050755584:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075733:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789403321.075740:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050756096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075774:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050756096:12345-0@lo:400:kworker.0 Request processed in 35us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.075780:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789403321.075815:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050756096:0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075831:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789403321.075840:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050756608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.075872:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050756608:12345-0@lo:400:kworker.0 Request processed in 34us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.075878:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789403321.075900:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050756608:0@lo:400:kworker.0 00000100:00100000:2.0:1789403321.076873:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050755712:0@lo:400:kworker.0 00000100:00100000:2.0:1789403321.076930:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403321.076961:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050756224:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077429:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050755840:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077473:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403321.077500:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050756352:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077526:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403321.077545:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050756864:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077567:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403321.077627:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756480 00000100:00100000:3.0:1789403321.077636:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756480 00000100:00100000:3.0:1789403321.077688:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756352 00000100:00100000:3.0:1789403321.077691:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756352 00000100:00100000:3.0:1789403321.077711:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756864 00000100:00100000:3.0:1789403321.077714:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756864 00000100:00100000:3.0:1789403321.077733:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789403321.077741:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050756480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077805:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050756480:12345-0@lo:400:kworker.0 Request processed in 64us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.077812:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789403321.077831:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789403321.077839:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050756352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077887:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050756352:12345-0@lo:400:kworker.0 Request processed in 50us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.077893:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789403321.077905:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789403321.077911:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050756864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.077937:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050756864:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.077943:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789403321.077960:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403321.077965:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403321.077968:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403321.078014:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050756352:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.078026:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050756864:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.078057:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755840 00000100:00100000:3.0:1789403321.078061:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755840 00000100:00100000:3.0:1789403321.078083:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789403321.078090:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050755840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.078146:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050755840:12345-0@lo:400:kworker.0 Request processed in 56us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.078152:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789403321.078176:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050755840:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.078232:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755712 00000100:00100000:3.0:1789403321.078236:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755712 00000100:00100000:3.0:1789403321.078263:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789403321.078271:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050755712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.078314:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050755712:12345-0@lo:400:kworker.0 Request processed in 45us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.078320:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789403321.078372:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050756480:0@lo:400:kworker.0 00000100:00100000:3.0:1789403321.078384:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403321.078420:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050756992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403321.078445:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403321.080807:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403321.080872:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050756736:0@lo:400:kworker.0 00000100:00100000:2.0:1789403321.080908:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403321.081114:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050755328 00000100:00100000:0.0:1789403321.082773:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756992 00000100:00100000:0.0:1789403321.082802:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756992 00000100:00100000:0.0:1789403321.082874:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789403321.082886:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050756992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403321.082930:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789403321.083437:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050756992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 385us (4820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.083449:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789403321.083712:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050756992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403321.083854:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050755712:0@lo:400:kworker.0 00000100:00100000:2.0:1789403321.083887:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756224 00000100:00100000:2.0:1789403321.083893:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756224 00000100:00100000:0.0:1789403321.083895:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050756736 00000100:00100000:0.0:1789403321.083900:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050756736 00000100:00080000:2.0:1789403321.083925:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403321.083947:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789403321.083957:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789403321.083963:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050756224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403321.083997:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050755328 00000100:00100000:2.0:1789403321.084028:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050756736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403321.084172:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050756224:12345-0@lo:400:kworker.0 Request processed in 207us (3384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.084179:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789403321.084955:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789403321.084966:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050755328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403321.085776:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789403321.085875:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050755328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 909us (11621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403321.085899:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00080000:1.0:1789403321.086565:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b5880 x1876325050756224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403321.086594:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050756224:0@lo:400:kworker.0 00000100:00100000:1.0:1789403321.086622:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1436a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050755328:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789403321.086661:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403321.088224:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050756736:12345-0@lo:400:kworker.0 Request processed in 4261us (7305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403321.088242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00080000:1.0:1789403321.093284:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b4000 x1876325050756736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403321.093310:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050756736:0@lo:400:kworker.0 00000100:00100000:2.0:1789403321.168288:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.169471:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038112256 00000100:00100000:3.0:1789403321.169488:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038112256 00000100:00100000:3.0:1789403321.169765:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:3.0:1789403321.169779:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+50:12311:x1876325038112256:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403321.169819:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403321.169848:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128983 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403321.169980:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789403321.170114:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761757 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128983 expref: 52 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.170129:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:3.0:1789403321.170131:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403321.170137:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b761757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128983 expref: 52 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.170154:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185c00, rc 0) 00000100:00100000:3.0:1789403321.170247:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+51:12311:x1876325038112256:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 472us (1973us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789403321.170273:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 173 00000100:00100000:2.0:1789403321.184207:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403321.184322:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038112512 00000100:00100000:1.0:1789403321.184336:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038112512 00000100:00100000:1.0:1789403321.184507:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1789403321.184520:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+51:12311:x1876325038112512:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403321.184835:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:12311:x1876325038112512:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 318us (641us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789403321.184844:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1789403321.261676:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403321.261804:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038112768 00000100:00100000:0.0:1789403321.261817:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038112768 00000100:00100000:0.0:1789403321.261904:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:0.0:1789403321.261918:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:12317:x1876325038112768:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403321.261950:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403321.261988:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761765 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12898a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.262125:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.262145:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 53 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.262156:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.262195:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 53 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.262211:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 53 pid: 13788 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403321.262254:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050757120:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403321.262377:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403321.267886:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050757120:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403321.267929:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403321.273634:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403321.273811:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038112896 00000100:00100000:0.0:1789403321.273824:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038112896 00010000:00010000:0.0:1789403321.273880:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 54 pid: 13788 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403321.273931:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 84 00000100:00100000:0.0:1789403321.273943:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:2389:x1876325038112896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403321.273961:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403321.273980:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 54 pid: 13788 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.273995:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 54 pid: 13788 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.274023:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761750 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12897c expref: 54 pid: 13788 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.274043:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403321.274050:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.274078:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.274088:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.274128:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403321.274197:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:2389:x1876325038112896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 255us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.274205:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 84 00010000:00010000:1.0:1789403321.274463:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.274475:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403321.274500:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00020000:1.0:1789403321.274521:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789403321.274683:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761765 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 54 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.274711:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 53 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.274719:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403321.274723:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403321.274725:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9e00, rc 0) 00000100:00100000:1.0:1789403321.274773:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:12317:x1876325038112768:12345-192.168.203.43@tcp:101:bash.0 Request processed in 12858us (13112us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789403321.274782:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 174 00000100:00100000:2.0:1789403321.280434:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.280644:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038113152 00000100:00100000:3.0:1789403321.280658:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038113152 00000100:00100000:3.0:1789403321.280735:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 175 00000100:00100000:3.0:1789403321.280747:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+53:12317:x1876325038113152:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:3.0:1789403321.281078:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.281101:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.281114:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789403321.281166:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789403321.281187:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bc6bed9 reply state 0000000054d604b2 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.281203:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.281212:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403321.281215:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789403321.281221:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789403321.281331:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12317:x1876325038113152:12345-192.168.203.43@tcp:36:bash.0 Request processed in 585us (943us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789403321.281338:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 175 00000020:00080000:3.0:1789403321.281344:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789403321.295101:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.297781:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038113280 00000100:00100000:3.0:1789403321.298567:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038113280 00000100:00100000:3.0:1789403321.298742:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:3.0:1789403321.298756:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12317:x1876325038113280:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403321.298802:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403321.298829:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761781 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128991 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.298953:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.298970:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 57 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.298982:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.299029:0:9061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 57 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.299048:0:9061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 57 pid: 6499 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403321.299064:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050757248:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403321.299186:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403321.303248:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050757248:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403321.303297:0:9061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403321.304157:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.304317:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038113408 00000100:00100000:3.0:1789403321.304344:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038113408 00010000:00010000:3.0:1789403321.304434:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 58 pid: 6499 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403321.304475:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 85 00000100:00100000:3.0:1789403321.304487:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:2389:x1876325038113408:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403321.304630:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403321.304640:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 58 pid: 6499 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.304655:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 58 pid: 6499 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.304684:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b76176c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12898a expref: 58 pid: 6499 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.304704:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403321.304710:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.304723:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.304732:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.304819:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403321.304904:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:2389:x1876325038113408:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 419us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.304924:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 85 00010000:00010000:0.0:1789403321.309338:0:9061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.309362:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403321.309464:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789403321.309469:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403321.309508:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.309564:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761781 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128991 expref: 57 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.309590:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128991 expref: 56 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.309601:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403321.309605:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403321.309630:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185800, rc 0) 00000100:00100000:0.0:1789403321.309742:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12317:x1876325038113280:12345-192.168.203.43@tcp:101:bash.0 Request processed in 10988us (14653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.309752:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 176 00000100:00100000:2.0:1789403321.318447:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.318552:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038113664 00000100:00100000:3.0:1789403321.318566:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038113664 00000100:00100000:3.0:1789403321.318643:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1789403321.318656:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12317:x1876325038113664:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1789403321.318973:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:12317:x1876325038113664:12345-192.168.203.43@tcp:35:bash.0 Request processed in 319us (587us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789403321.318982:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1789403321.410154:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403321.410237:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038113920 00000100:00100000:1.0:1789403321.410251:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038113920 00000100:00100000:1.0:1789403321.410338:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:1.0:1789403321.410351:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+57:12327:x1876325038113920:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403321.410429:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403321.410457:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76178f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128998 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403321.412307:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789403321.412587:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76178f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128998 expref: 59 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.412660:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:0.0:1789403321.412663:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789403321.412670:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76178f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128998 expref: 59 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.412691:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:0.0:1789403321.412992:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12327:x1876325038113920:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2641us (2849us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789403321.413003:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 177 00000100:00100000:2.0:1789403321.418422:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.418695:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038114048 00000100:00100000:3.0:1789403321.418708:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038114048 00000100:00100000:3.0:1789403321.418804:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 178 00000100:00100000:3.0:1789403321.418817:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12327:x1876325038114048:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1789403321.419081:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419103:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419118:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419132:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419140:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419148:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419261:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419272:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419280:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403321.419351:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419368:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419376:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419384:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419948:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403321.419954:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419964:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.419981:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403321.419985:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403321.419992:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420010:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b76179d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420026:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420032:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420039:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420044:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403321.420048:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420054:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420063:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:3.0:1789403321.420065:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403321.420069:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420075:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7617a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420085:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420091:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420103:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420109:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403321.420112:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420119:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420126:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403321.420129:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403321.420132:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.420138:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403321.420312:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12327:x1876325038114048:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1494us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.420322:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 178 00000100:00100000:2.0:1789403321.433373:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403321.433729:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038114304 00000100:00100000:1.0:1789403321.433744:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038114304 00000100:00100000:1.0:1789403321.433832:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1789403321.433969:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12327:x1876325038114304:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403321.434283:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:12327:x1876325038114304:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 319us (925us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789403321.434292:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:2.0:1789403321.487980:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403321.488093:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038114560 00000100:00100000:0.0:1789403321.488108:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038114560 00000100:00100000:0.0:1789403321.488188:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 179 00000100:00100000:0.0:1789403321.488200:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:12331:x1876325038114560:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403321.488233:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403321.488259:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb12899f expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488357:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488431:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488448:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488462:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488470:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488477:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488761:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488772:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.488780:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789403321.489028:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:0.0:1789403321.489036:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00020000:0.0:1789403321.489047:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:0.0:1789403321.489140:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489148:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489165:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489171:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403321.489176:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489185:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489199:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:0.0:1789403321.489204:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403321.489209:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489216:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7617b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489232:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489239:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489245:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489250:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403321.489253:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489268:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489276:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:0.0:1789403321.489279:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403321.489282:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489288:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489333:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12899f expref: 62 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489347:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12899f expref: 61 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.489354:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403321.489356:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403321.489359:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8200, rc 0) 00000100:00100000:0.0:1789403321.489974:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:12331:x1876325038114560:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1772us (2139us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789403321.489994:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 179 00000100:00100000:2.0:1789403321.494681:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403321.498003:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403321.498133:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038114688 00000100:00100000:0.0:1789403321.498148:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038114688 00000100:00100000:0.0:1789403321.498233:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1789403321.498246:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:2388:x1876325038114688:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403321.498289:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403321.498322:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12899f expref: 61 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.498350:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403321.498356:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403321.498456:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:2388:x1876325038114688:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 212us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.498465:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1789403321.502024:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038114816 00000100:00100000:1.0:1789403321.502068:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038114816 00000100:00100000:1.0:1789403321.502149:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 180 00000100:00100000:1.0:1789403321.502163:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:12331:x1876325038114816:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:1.0:1789403321.502263:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502289:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502305:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502353:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502361:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502369:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502377:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403321.502382:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502416:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502431:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403321.502435:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403321.502442:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403321.502460:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b7617d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403321.502921:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:12331:x1876325038114816:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 624us (4796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403321.502932:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 180 00000100:00100000:2.0:1789403321.508726:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.509146:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038115072 00000100:00100000:3.0:1789403321.509159:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038115072 00000100:00100000:3.0:1789403321.509236:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403321.509249:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:12331:x1876325038115072:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403321.510726:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:12331:x1876325038115072:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 1468us (2004us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789403321.510742:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403321.674952:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403321.675189:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038115328 00000100:00100000:0.0:1789403321.675202:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038115328 00000100:00100000:0.0:1789403321.675280:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:0.0:1789403321.675292:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+61:12349:x1876325038115328:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1789403321.675325:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403321.675353:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289a6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.675537:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.675557:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.675573:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403321.675586:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00020000:0.0:1789403321.675596:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602069505 00010000:00010000:0.0:1789403321.675742:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289a6 expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.675765:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289a6 expref: 63 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.675775:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403321.675779:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789403321.675795:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8400, rc 0) 00000100:00100000:0.0:1789403321.675892:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12349:x1876325038115328:12345-192.168.203.43@tcp:101:cat.0 Request processed in 601us (953us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789403321.675900:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 181 00000100:00100000:2.0:1789403321.701081:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403321.701279:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038115456 00000100:00100000:0.0:1789403321.701293:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038115456 00000100:00100000:0.0:1789403321.701368:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:0.0:1789403321.701380:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12350:x1876325038115456:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403321.701452:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403321.701480:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289ad expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.701765:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.701796:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.701811:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403321.701926:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789403321.701948:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403321.702035:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.702069:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7617f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289ad expref: 65 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.702091:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289ad expref: 64 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403321.702100:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:0.0:1789403321.702105:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403321.702109:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9200, rc 0) 00000100:00100000:0.0:1789403321.702238:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12350:x1876325038115456:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 859us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403321.702247:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 182 00000100:00100000:2.0:1789403321.708300:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403321.708459:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038115840 00000100:00100000:1.0:1789403321.708472:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038115840 00000100:00100000:1.0:1789403321.708647:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1789403321.708660:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12350:x1876325038115840:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403321.709192:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12350:x1876325038115840:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 533us (904us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789403321.709201:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:2.0:1789403321.711730:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.711928:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038115968 00000100:00100000:3.0:1789403321.711941:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038115968 00000100:00100000:3.0:1789403321.712120:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1789403321.712133:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12350:x1876325038115968:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:3.0:1789403321.712153:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789403321.712184:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761788 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128991 expref: 65 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.712210:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b7617e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289a6 expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.712224:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b761685 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12894b expref: 63 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.712235:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403321.712241:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403321.712310:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:12350:x1876325038115968:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 181us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.712319:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1789403321.715097:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.715173:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038116096 00000100:00100000:3.0:1789403321.715185:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038116096 00000100:00100000:3.0:1789403321.715255:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:3.0:1789403321.715268:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:12350:x1876325038116096:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:3.0:1789403321.715578:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.715610:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.715641:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403321.715765:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789403321.716112:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:12350:x1876325038116096:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 845us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.716122:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 183 00000100:00100000:2.0:1789403321.747124:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403321.751104:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038116224 00000100:00100000:3.0:1789403321.751126:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038116224 00000100:00100000:3.0:1789403321.753933:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 184 00000100:00100000:3.0:1789403321.753964:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+62:12352:x1876325038116224:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403321.753992:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403321.754021:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761806 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289b4 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754218:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754236:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754311:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754327:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754335:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754363:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754483:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754494:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.754501:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403321.755220:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789403321.755227:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403321.755314:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755332:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755342:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755348:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755356:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755362:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403321.755367:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755385:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755489:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403321.755492:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403321.755499:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755505:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76180d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755522:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755648:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755654:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755659:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403321.755662:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755667:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755675:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:3.0:1789403321.755677:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403321.755680:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.755696:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.756005:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761806 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 64 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.756024:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 63 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403321.756032:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403321.756034:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403321.756037:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184600, rc 0) 00000100:00100000:3.0:1789403321.756499:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12352:x1876325038116224:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2438us (9276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403321.756510:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 184 00010000:00010000:2.0:1789403321.841628:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403322.610638:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789403322.610653:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403322.610720:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789403322.610732:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789403322.610919:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442e3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050757376:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789403322.611039:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789403322.620009:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.620123:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442e3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050757376:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789403322.620304:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038116352 00000100:00100000:3.0:1789403322.620314:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038116352 00000100:00100000:3.0:1789403322.620423:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:3.0:1789403322.620437:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12363:x1876325038116352:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789403322.620482:0:9061:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789403322.620770:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12363:x1876325038116352:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 335us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.620788:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 185 00000100:00100000:2.0:1789403322.623906:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.624128:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038116480 00000100:00100000:3.0:1789403322.624141:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038116480 00000100:00100000:3.0:1789403322.624216:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:3.0:1789403322.624242:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12363:x1876325038116480:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.624344:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624368:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624385:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624423:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624431:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624438:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624468:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624478:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624542:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403322.624599:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789403322.624604:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403322.624617:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624917:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624924:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624932:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624938:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403322.624943:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624951:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624966:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:3.0:1789403322.624969:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403322.624975:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624982:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b761822 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.624999:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625006:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625012:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625024:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403322.625028:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625034:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625043:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.625045:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403322.625048:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625054:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761829 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625070:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625076:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625082:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625087:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403322.625089:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625095:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625112:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403322.625114:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403322.625117:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.625123:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b761830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.625232:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12363:x1876325038116480:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 993us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.625243:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 186 00000100:00100000:2.0:1789403322.636385:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.636507:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038116736 00000100:00100000:1.0:1789403322.636521:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038116736 00000100:00100000:1.0:1789403322.636595:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:1.0:1789403322.636609:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12363:x1876325038116736:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403322.636790:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403322.636819:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761837 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289bb expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.636967:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.636986:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637010:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403322.637025:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00020000:1.0:1789403322.637037:0:6500:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:1.0:1789403322.637126:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637133:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637140:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637147:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403322.637151:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637160:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637173:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:1.0:1789403322.637177:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403322.637182:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637189:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76183e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637238:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761837 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289bb expref: 65 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637263:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:1.0:1789403322.637265:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403322.637270:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b761837 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289bb expref: 65 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.637281:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063400, rc 0) 00000100:00100000:1.0:1789403322.637368:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12363:x1876325038116736:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 762us (997us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789403322.637376:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 187 00000100:00100000:2.0:1789403322.664190:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403322.664869:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038116864 00000100:00100000:0.0:1789403322.664884:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038116864 00000100:00100000:0.0:1789403322.664974:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:0.0:1789403322.664987:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12363:x1876325038116864:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789403322.665034:0:6501:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789403322.665194:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12363:x1876325038116864:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 208us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403322.665203:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 188 00000100:00100000:2.0:1789403322.704826:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000040:00080000:0.0:1789403322.705317:0:14689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403322.705325:0:14689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403322.705354:0:14689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789403322.705367:0:14689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789403322.707414:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038117120 00000100:00100000:1.0:1789403322.707434:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038117120 00000100:00100000:1.0:1789403322.707516:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:1.0:1789403322.707530:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12363:x1876325038117120:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403322.707559:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403322.707563:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789403322.707597:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b7617f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289ad expref: 64 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.707620:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403322.707627:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403322.707644:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76184c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289c2 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403322.708149:0:6499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789403322.708314:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761853 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.708338:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.708350:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403322.708359:0:6499:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:1.0:1789403322.708374:0:6499:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:1.0:1789403322.708459:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76184c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c2 expref: 66 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.708476:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761853 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c2 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.708484:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a142628500) 00010000:00010000:1.0:1789403322.708487:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403322.708490:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:1.0:1789403322.708577:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12363:x1876325038117120:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1050us (3765us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789403322.708585:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 189 00000100:00100000:2.0:1789403322.720662:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.720758:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038117376 00000100:00100000:1.0:1789403322.720772:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038117376 00000100:00100000:1.0:1789403322.720867:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:1.0:1789403322.720880:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12363:x1876325038117376:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789403322.720959:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403322.720992:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b761853 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c2 expref: 65 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721031:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a142628500) 00010000:00010000:1.0:1789403322.721043:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403322.721072:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721088:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721099:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721114:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721121:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721127:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721181:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721189:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721197:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721203:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403322.721208:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721224:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721234:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403322.721237:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403322.721241:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721247:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b761861 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721256:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721262:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721269:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721274:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403322.721277:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721282:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721289:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x93edf0ca (ffff90a142628200) 00010000:00010000:1.0:1789403322.721292:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403322.721295:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.721312:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b761868 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x93edf0ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403322.721441:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12363:x1876325038117376:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 561us (789us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403322.721449:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 190 00000100:00100000:1.0:1789403322.730994:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.731127:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038117504 00000100:00100000:3.0:1789403322.731140:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038117504 00000100:00100000:3.0:1789403322.731218:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:3.0:1789403322.731231:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12363:x1876325038117504:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.731260:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403322.731289:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76186f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289c9 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.731335:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.731352:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.731367:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.731558:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76186f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 66 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.731589:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 65 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.731600:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.731603:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403322.731607:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184800, rc 0) 00000100:00100000:3.0:1789403322.731687:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12363:x1876325038117504:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 458us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.731695:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 191 00000100:00100000:1.0:1789403322.738126:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.738229:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038117760 00000100:00100000:3.0:1789403322.738243:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038117760 00000100:00100000:3.0:1789403322.738319:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:3.0:1789403322.738332:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1436a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12363:x1876325038117760:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.738472:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.738505:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.738518:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403322.738746:0:9061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789403322.738757:0:9061:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368737367155ns, next at 369737364011ns, rc = 0 00000004:00010000:3.0:1789403322.738923:0:9061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be48b867 reply state 000000007b409c09 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.738957:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.738966:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.738970:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789403322.738975:0:9061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789403322.739100:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1436a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12363:x1876325038117760:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 770us (985us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789403322.739108:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 192 00000100:00100000:0.0:1789403322.754807:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.754890:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038117888 00000100:00100000:1.0:1789403322.754905:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038117888 00000100:00100000:1.0:1789403322.754988:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:1.0:1789403322.755001:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12363:x1876325038117888:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403322.755034:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403322.755060:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289d0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.755133:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 68 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.755151:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 68 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.755183:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:1.0:1789403322.755187:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403322.755193:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05000, rc 0) 00000100:00100000:1.0:1789403322.755269:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:12363:x1876325038117888:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 270us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403322.755289:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:0.0:1789403322.761789:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.762068:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038118016 00000100:00100000:3.0:1789403322.762083:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038118016 00000100:00100000:3.0:1789403322.762193:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1789403322.762206:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2389:x1876325038118016:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789403322.762530:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038118016:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 325us (764us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789403322.762538:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00080000:0.0:1789403322.762737:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403322.767674:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.767828:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038118272 00000100:00100000:3.0:1789403322.767842:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038118272 00000100:00100000:3.0:1789403322.767908:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1789403322.767920:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:12363:x1876325038118272:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789403322.768219:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+69:12363:x1876325038118272:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 300us (557us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789403322.768227:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1789403322.770997:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.771084:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038118528 00000100:00100000:1.0:1789403322.771097:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038118528 00000100:00100000:1.0:1789403322.771165:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1789403322.771432:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+69:12363:x1876325038118528:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789403322.771694:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+69:12363:x1876325038118528:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 266us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403322.771703:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:0.0:1789403322.779136:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.779325:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038118656 00000100:00100000:3.0:1789403322.779339:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038118656 00000100:00100000:3.0:1789403322.779459:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:3.0:1789403322.779474:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+69:12363:x1876325038118656:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.779501:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403322.779527:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76188b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289d7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.779633:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.779652:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.779667:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403322.779726:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403322.779750:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.779792:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76188b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d7 expref: 71 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.779815:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d7 expref: 70 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.779825:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.779828:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789403322.779833:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184400, rc 0) 00000100:00100000:3.0:1789403322.779906:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+70:12363:x1876325038118656:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 436us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.779926:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 195 00000100:00100000:1.0:1789403322.793656:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.793716:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038118784 00000100:00100000:1.0:1789403322.793728:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038118784 00000100:00100000:1.0:1789403322.793977:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403322.793990:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038118784:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403322.794015:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403322.794040:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289de expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403322.794072:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa820ba, blocks: 0x0 00010000:00010000:1.0:1789403322.794096:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1789403322.794113:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403322.794125:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 8 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.794153:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 8 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.794184:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04c00, rc 0) 00000100:00100000:1.0:1789403322.794263:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038118784:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 276us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403322.794271:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403322.804589:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.805816:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119040 00000100:00100000:3.0:1789403322.805835:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119040 00000100:00100000:3.0:1789403322.805911:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:3.0:1789403322.805924:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+70:12363:x1876325038119040:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789403322.806069:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1431fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+70:12363:x1876325038119040:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 147us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.806077:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 196 00000100:00100000:1.0:1789403322.812036:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.812123:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119168 00000100:00100000:3.0:1789403322.812136:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119168 00000100:00100000:3.0:1789403322.812219:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403322.812231:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:12363:x1876325038119168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.812254:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403322.812277:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289e5 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.812315:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.812325:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403322.812330:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403322.812335:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 9 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.812377:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.812440:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.812456:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876325050757504:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403322.813260:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403322.819870:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876325050757504:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403322.819922:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 9 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.819948:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185a00, rc 0) 00000100:00100000:3.0:1789403322.820029:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:12363:x1876325038119168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 7800us (8004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.820038:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:2.0:1789403322.831077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403322.831145:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119296 00000100:00100000:2.0:1789403322.831158:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119296 00010000:00010000:2.0:1789403322.831231:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403322.831296:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:2.0:1789403322.831326:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2389:x1876325038119296:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403322.831348:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403322.831379:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.831417:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.831450:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012ad4e08/0x5fb08b1e5b761899 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289de expref: 9 pid: 8416 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.831474:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403322.831479:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403322.831719:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.831733:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.831812:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403322.831830:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144464380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6486:1876325050757632:192.168.203.43@tcp:105: 00000100:00100000:2.0:1789403322.831932:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403322.860348:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403322.860428:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119424 00000100:00100000:1.0:1789403322.860440:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119424 00002000:00100000:1.0:1789403322.860514:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90a2488b4e00 x1876325038119424/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:483/0 lens 504/0 e 0 to 0 dl 1789403333 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789403322.860528:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a2488b4e00 with x1876325038119424 ext(0->8) 00002000:00010000:1.0:1789403322.860536:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a2488b4e00 00000100:00100000:1.0:1789403322.860584:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1789403322.860595:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038119424:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789403322.860960:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144464380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6486:1876325050757632:192.168.203.43@tcp:105: 00010000:00010000:0.0:1789403322.860991:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403322.861063:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2389:x1876325038119296:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 29742us (30004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403322.861074:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:1.0:1789403322.862833:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:2390:x1876325038119424:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 2226us (2487us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789403322.862848:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00002000:00100000:1.0:1789403322.862863:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90a2488b4e00 x1876325038119424/t4294967315(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:483/0 lens 504/448 e 0 to 0 dl 1789403333 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789403322.862875:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a2488b4e00 with x1876325038119424 ext(0->8) 00002000:00010000:1.0:1789403322.862882:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a2488b4e00 00010000:00010000:0.0:1789403322.865600:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403322.870768:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.871059:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119552 00000100:00100000:3.0:1789403322.871075:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119552 00000100:00100000:3.0:1789403322.871154:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 197 00000100:00100000:3.0:1789403322.871180:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+70:12363:x1876325038119552:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789403322.875008:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1789403322.875026:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1789403322.875073:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789403322.875104:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789403322.875115:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a142605780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789403322.875121:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a142482b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a142605480 00000020:00080000:3.0:1789403322.875140:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a142482000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a26076c400 00000100:00100000:0.0:1789403322.875559:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050757760:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1789403322.875644:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1789403322.875652:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789403322.875722:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789403322.875734:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403322.875746:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050757888:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789403322.875796:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.875798:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403322.875819:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875827:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875834:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.875841:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875851:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875872:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a142628000) 00010000:00010000:2.0:1789403322.875876:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403322.875882:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875889:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b7615c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875912:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875919:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875925:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875929:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.875940:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875946:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875956:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403322.875958:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403322.875961:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875967:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b7615cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875982:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875989:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.875995:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876000:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.876003:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876010:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876021:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628800) 00010000:00010000:2.0:1789403322.876024:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403322.876035:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876041:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b76160e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876058:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876065:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876071:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876076:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.876079:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876084:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876092:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:2.0:1789403322.876094:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403322.876097:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876102:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761711 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876113:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876119:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876133:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876138:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.876140:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876147:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876155:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:2.0:1789403322.876158:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403322.876161:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876167:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063800/0x5fb08b1e5b761734 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876179:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876186:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876192:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876197:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.876200:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876216:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876226:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:2.0:1789403322.876228:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403322.876231:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876237:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b76177a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876251:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876257:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876263:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876268:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403322.876271:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876277:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876285:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:2.0:1789403322.876287:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789403322.876289:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.876305:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b76187d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403322.876436:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050757760 00000100:00100000:0.0:1789403322.876447:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050757760 00000100:00100000:0.0:1789403322.876498:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050757888 00000100:00100000:0.0:1789403322.876501:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050757888 00000100:00100000:0.0:1789403322.876679:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403322.876691:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050757760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789403322.876705:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12363:x1876325038119552:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 5535us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.876717:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 197 00002000:00010000:0.0:1789403322.876852:0:8415:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789403322.876857:0:8415:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789403322 00002000:00010000:0.0:1789403322.876859:0:8415:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789403322.876862:0:8415:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789403322 -> 1789403322 00002000:00010000:0.0:1789403322.876864:0:8415:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789403322.876901:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403322.876913:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050757888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789403322.876966:0:8417:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00000100:00100000:0.0:1789403322.876973:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050757760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (1322us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789403322.876993:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00010000:3.0:1789403322.877002:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa820b7, atime: 0x0, ctime: 0x6aa820b7, blocks: 0x8 00010000:00010000:3.0:1789403322.877011:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.877028:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1789403322.877033:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403322.877040:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.877060:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789403322.877065:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a1442b4000/2, rc 0, transno 4294967316 00010000:00010000:3.0:1789403322.877070:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403322.877074:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050757760:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789403322.877093:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.877116:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403322.877155:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403322.877163:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.877174:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403322.877179:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.877188:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.877205:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.877212:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008785d9e/0x5fb08b1e5b7618a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.877232:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403322.877235:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403322.877237:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403322.877269:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050757888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 358us (1469us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789403322.877276:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1789403322.877283:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a1442ec000/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789403322.877297:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050757888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789403322.885935:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.886093:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119680 00000100:00100000:3.0:1789403322.886107:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119680 00000100:00100000:3.0:1789403322.886207:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1789403322.886223:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:2389:x1876325038119680:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789403322.890092:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789403322.890111:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789403322.890569:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038119680:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 4342us (4642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403322.890600:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:0.0:1789403322.918959:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.919096:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038119936 00000100:00100000:3.0:1789403322.919110:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038119936 00000100:00100000:3.0:1789403322.919184:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:3.0:1789403322.919195:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12363:x1876325038119936:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.919281:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403322.919507:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b761892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d7 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.919530:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.919537:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403322.920053:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.920084:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.920096:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403322.920433:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000949799af reply state 000000006b5208fc transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.920450:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.920458:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.920461:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789403322.920465:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789403322.920819:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:12363:x1876325038119936:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1623us (1869us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789403322.920829:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:3.0:1789403322.935571:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403322.935821:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038120064 00000100:00100000:2.0:1789403322.935835:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038120064 00000100:00100000:2.0:1789403322.935970:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:2.0:1789403322.935983:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038120064:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789403322.936189:0:8563:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789403322.936193:0:8563:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789403322 -> 1789403321 00002000:00010000:2.0:1789403322.936196:0:8563:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789403319 00002000:00010000:2.0:1789403322.936199:0:8563:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789403322 -> 1789403321 00002000:00010000:2.0:1789403322.936201:0:8563:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789403322.936282:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038120064:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 302us (726us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789403322.936291:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:1.0:1789403322.950007:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.950097:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038120320 00000100:00100000:3.0:1789403322.950110:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038120320 00000100:00100000:3.0:1789403322.950194:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 199 00000100:00100000:3.0:1789403322.950207:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:12363:x1876325038120320:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.950295:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.950318:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 20 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.950343:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.950411:0:9061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 20 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.950429:0:9061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 20 pid: 13788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.950447:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050758016:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403322.950563:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789403322.952895:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050758016:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403322.952934:0:9061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403322.959981:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.960543:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038120448 00000100:00100000:3.0:1789403322.960556:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038120448 00010000:00010000:3.0:1789403322.960627:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 21 pid: 13788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.960685:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 87 00000100:00100000:3.0:1789403322.960697:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:2390:x1876325038120448:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403322.960717:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403322.960725:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 21 pid: 13788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.960741:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 21 pid: 13788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.960769:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184800/0x5fb08b1e5b761876 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289c9 expref: 21 pid: 13788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.960813:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403322.960819:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.960832:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.960842:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.960874:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403322.960945:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:2390:x1876325038120448:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 250us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.960954:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 87 00010000:00010000:1.0:1789403322.961187:0:9061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961197:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961249:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961257:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961265:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961272:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403322.961277:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961286:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961305:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:1.0:1789403322.961308:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789403322.961313:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403322.961320:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7618b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403322.961378:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12363:x1876325038120320:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 11174us (11383us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789403322.961429:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 199 00000100:00100000:1.0:1789403322.972977:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.973123:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038120576 00000100:00100000:3.0:1789403322.973136:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038120576 00000100:00100000:3.0:1789403322.973216:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1789403322.973229:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038120576:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789403322.973292:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.973319:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.973329:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403322.973335:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403322.973340:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.973423:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.973441:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 8 pid: 8417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.973459:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876325050758144:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403322.973587:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789403322.978239:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876325050758144:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403322.978284:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403322.980544:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403322.982096:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038120704 00000100:00100000:3.0:1789403322.982111:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038120704 00010000:00010000:3.0:1789403322.982168:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 9 pid: 8417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403322.982228:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 88 00000100:00100000:3.0:1789403322.982239:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a606450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038120704:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403322.982258:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403322.982285:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 9 pid: 8417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.982300:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 9 pid: 8417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.982329:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f5996ef/0x5fb08b1e5b7618a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289e5 expref: 9 pid: 8417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.982358:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403322.982363:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403322.982370:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.982381:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403322.982438:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403322.982503:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a606450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038120704:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 266us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403322.982511:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 88 00010000:00010000:2.0:1789403322.982934:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.982946:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.982972:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.982981:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.983003:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.983011:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403322.983016:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.983027:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.983041:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403322.983049:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b7618bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403322.983124:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038120576:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 9897us (10159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403322.983132:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1789403322.993002:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403322.993162:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038120960 00000100:00100000:0.0:1789403322.993185:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038120960 00000100:00100000:0.0:1789403322.993262:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 200 00000100:00100000:0.0:1789403322.993275:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12363:x1876325038120960:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789403322.993415:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403322.993439:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403322.993450:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403322.993498:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403322.993514:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 19 pid: 6500 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403322.993530:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050758272:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403322.993643:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403323.007031:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403323.007062:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121088 00000100:00100000:2.0:1789403323.007073:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121088 00010000:00010000:2.0:1789403323.007129:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 20 pid: 6500 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403323.007196:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00100000:2.0:1789403323.007207:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:2390:x1876325038121088:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403323.007226:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403323.007234:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 20 pid: 6500 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403323.007249:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 20 pid: 6500 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403323.007283:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:2.0:1789403323.007290:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403323.007301:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403323.007310:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403323.007334:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403323.007417:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:2390:x1876325038121088:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 211us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403323.007426:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 89 00000100:00080000:2.0:1789403323.007453:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789403323.010454:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76170a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12896e expref: 19 pid: 6500 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403323.010484:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050758272:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403323.010521:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.010532:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.010539:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.011062:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.011081:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.011092:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.011139:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.011157:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 19 pid: 6501 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403323.011243:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050758400:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403323.011531:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403323.018250:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050758400:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403323.018364:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403323.029932:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403323.032890:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121216 00000100:00100000:0.0:1789403323.032912:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121216 00010000:00010000:0.0:1789403323.032972:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 20 pid: 6501 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403323.033016:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 90 00000100:00100000:0.0:1789403323.033027:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:2389:x1876325038121216:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403323.033046:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403323.033053:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 20 pid: 6501 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033068:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 20 pid: 6501 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033096:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761884 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289d0 expref: 20 pid: 6501 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033118:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:0.0:1789403323.033124:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033136:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033145:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033180:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403323.033270:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:2389:x1876325038121216:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 243us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403323.033280:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 90 00010000:00010000:0.0:1789403323.033315:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.033324:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403323.033476:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789403323.033611:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789403323.033651:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789403323.033753:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050758528:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789403323.033841:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403323.033877:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2435040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403323.034522:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050758528 00000100:00100000:3.0:1789403323.034532:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050758528 00000100:00100000:3.0:1789403323.034595:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789403323.034609:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050758528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789403323.034733:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050758528:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403323.034741:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1789403323.034783:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403323.034819:0:6499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789403323.034825:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a1442b4000, transno 4294967316 00000100:00100000:3.0:1789403323.034841:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050758528:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789403323.035008:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789403323.035076:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050758656:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789403323.035127:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403323.035157:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403323.036730:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050758656 00000100:00100000:3.0:1789403323.036745:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050758656 00000100:00100000:3.0:1789403323.036824:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789403323.036836:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050758656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789403323.037047:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6499:x1876325050758656:12345-0@lo:1000:mdt00_000.0 Request processed in 214us (1919us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789403323.037055:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789403323.037115:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050758656:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789403323.037358:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037370:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037379:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037412:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403323.037419:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037428:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037448:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403323.037451:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403323.037457:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037478:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b7618ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037510:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037517:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037524:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037530:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403323.037532:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037539:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037549:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403323.037551:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403323.037554:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037560:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b7617ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037587:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037603:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037621:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037661:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.037676:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 22 pid: 6500 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403323.037692:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050758784:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403323.037815:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403323.050053:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403323.050090:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121344 00000100:00100000:0.0:1789403323.050102:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121344 00010000:00010000:0.0:1789403323.050150:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 23 pid: 6500 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403323.050211:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 91 00000100:00100000:0.0:1789403323.050224:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:2390:x1876325038121344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403323.050243:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403323.050252:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 23 pid: 6500 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.050268:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 23 pid: 6500 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.050311:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:0.0:1789403323.050317:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.050329:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.050337:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403323.050361:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403323.050443:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:2390:x1876325038121344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 221us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403323.050450:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 91 00010000:00010000:3.0:1789403323.051277:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b76181b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289b4 expref: 22 pid: 6500 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403323.051301:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050758784:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403323.051332:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051344:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051351:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051366:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051373:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051411:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051418:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403323.051424:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051433:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051446:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403323.051450:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403323.051454:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051461:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7618d1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051472:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051478:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051562:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051568:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403323.051571:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051738:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051748:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8b000) 00010000:00010000:3.0:1789403323.051750:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403323.051754:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.051760:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7618c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403323.051962:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12363:x1876325038120960:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 58688us (58974us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789403323.051973:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 200 00000020:00080000:3.0:1789403323.051979:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789403323.052416:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403323.052422:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403323.053102:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789403323.053115:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789403323.062130:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403323.062169:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121600 00000100:00100000:3.0:1789403323.062178:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121600 00000100:00100000:3.0:1789403323.062230:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1789403323.062241:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12363:x1876325038121600:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789403323.062556:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789403323.063310:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789403323.063356:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063372:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063385:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063432:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063439:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063446:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063464:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789403323.063706:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:12363:x1876325038121600:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1465us (1584us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789403323.063714:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000020:00080000:3.0:1789403323.063718:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789403323.063767:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403323.063784:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063792:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403323.063797:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063806:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063820:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:3.0:1789403323.063824:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789403323.063828:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063845:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7618d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403323.063865:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403323.063867:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403323.063871:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403323.889539:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403323.977376:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403323.977460:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403323.977469:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121856 00000100:00100000:2.0:1789403323.977494:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121856 00000100:00100000:3.0:1789403323.977503:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403323.977544:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403323.977550:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038122368 00000100:00100000:2.0:1789403323.977555:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038122368 00000100:00100000:3.0:1789403323.977574:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403323.977598:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403323.977624:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038122112 00000100:00100000:3.0:1789403323.977631:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403323.977631:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038122112 00000100:00100000:0.0:1789403323.977664:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038122240 00000100:00100000:0.0:1789403323.977668:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038122240 00000100:00100000:0.0:1789403323.977698:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1789403323.977714:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038122112:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403323.977797:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038122112:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 90us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403323.977805:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:0.0:1789403323.977821:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:0.0:1789403323.977845:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038122240:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403323.977874:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038122240:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403323.977880:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1789403323.980682:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121728 00000100:00100000:3.0:1789403323.980696:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121728 00000100:00100000:3.0:1789403323.980749:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 388 00000100:00100000:3.0:1789403323.980760:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038121728:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403323.980840:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+13:2387:x1876325038121728:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 82us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403323.980847:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 388 00000100:00080000:3.0:1789403323.980880:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403323.980886:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403323.980940:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038121984 00000100:00100000:2.0:1789403323.980945:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038121984 00000100:00100000:2.0:1789403323.980981:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038122496 00000100:00100000:2.0:1789403323.980985:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038122496 00000100:00100000:2.0:1789403323.981005:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 322 00000100:00100000:2.0:1789403323.981013:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:2387:x1876325038121856:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403323.981063:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:2387:x1876325038121856:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403323.981070:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 322 00000100:00100000:2.0:1789403323.981086:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 323 00000100:00100000:2.0:1789403323.981093:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038122368:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403323.981120:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038122368:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403323.981126:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 323 00000100:00100000:2.0:1789403323.981138:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 324 00000100:00100000:2.0:1789403323.981144:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038121984:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403323.981166:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2387:x1876325038121984:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (3592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403323.981172:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 324 00000100:00100000:2.0:1789403323.981183:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 325 00000100:00100000:2.0:1789403323.981189:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038122496:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403323.981211:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2387:x1876325038122496:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403323.981230:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 325 00000100:00080000:0.0:1789403323.984716:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403324.147570:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050758912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403324.147640:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403324.147774:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050758912 00000100:00100000:3.0:1789403324.147782:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050758912 00000100:00100000:3.0:1789403324.147843:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789403324.147853:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050758912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403324.147883:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789403324.147941:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050758912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403324.147948:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789403324.148243:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050759040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403324.148278:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403324.148319:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050759040 00000100:00100000:3.0:1789403324.148325:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050759040 00000100:00100000:3.0:1789403324.148367:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789403324.148375:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a275111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050759040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403324.148386:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789403324.148490:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a275111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050759040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403324.148497:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789403324.148654:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050758912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789403324.148683:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403324.148705:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050759040:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789403324.517648:0:14741:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789403324.517657:0:14741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403324.517682:0:14741:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789403324.517690:0:14741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403324.656552:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403324.656606:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038122752 00000100:00100000:2.0:1789403324.656616:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038122752 00000100:00100000:2.0:1789403324.656669:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:2.0:1789403324.656679:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:12381:x1876325038122752:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403324.656699:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403324.656718:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7618df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289ec expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.656844:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7618e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.656859:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7618e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.656875:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7618e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403324.656887:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789403324.656988:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7618df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289ec expref: 26 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.657005:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7618e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289ec expref: 25 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.657025:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403324.657028:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789403324.657033:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6200, rc 0) 00000100:00100000:2.0:1789403324.657106:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:12381:x1876325038122752:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 428us (560us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789403324.657113:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:0.0:1789403324.658638:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403324.658658:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050759168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403324.658713:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403324.658798:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050759168 00000100:00100000:1.0:1789403324.658807:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050759168 00000100:00100000:1.0:1789403324.658952:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789403324.658963:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050759168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403324.658995:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403324.659050:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050759168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403324.659071:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789403324.659119:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050759168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403324.669738:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403324.669918:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038122880 00000100:00100000:0.0:1789403324.669928:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038122880 00000100:00100000:0.0:1789403324.670051:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:0.0:1789403324.670063:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:12381:x1876325038122880:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:0.0:1789403324.671255:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671276:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671301:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671318:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671326:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671333:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671435:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671444:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671451:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403324.671808:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671823:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671840:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671847:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671865:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403324.671870:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671878:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671890:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:0.0:1789403324.671894:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403324.671898:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671905:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b7618f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671918:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671924:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671930:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671935:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403324.671939:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671954:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671972:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a243d8b700) 00010000:00010000:0.0:1789403324.671975:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403324.671978:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671984:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7618fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.671999:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.672006:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.672012:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.672018:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403324.672021:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.672026:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.672033:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a243d8bd00) 00010000:00010000:0.0:1789403324.672036:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403324.672039:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.672044:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403324.672152:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:12381:x1876325038122880:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 2088us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403324.672161:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:3.0:1789403324.722803:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403324.722852:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038123136 00000100:00100000:3.0:1789403324.722863:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038123136 00000100:00100000:3.0:1789403324.722921:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:3.0:1789403324.722932:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+25:12384:x1876325038123136:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403324.722961:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403324.722982:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761909 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289f3 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723055:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723070:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723082:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723111:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723120:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723184:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723296:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723305:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723312:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403324.723319:0:13788:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:3.0:1789403324.723324:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000004:00020000:3.0:1789403324.723332:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:3.0:1789403324.723416:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723424:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723431:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723437:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403324.723441:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.723455:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724021:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403324.724026:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403324.724034:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724041:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761910 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724055:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724062:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724068:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724074:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403324.724077:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724083:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724091:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a1434a8c00) 00010000:00010000:3.0:1789403324.724094:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403324.724096:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.724114:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761917 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.725455:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761909 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 28 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.725774:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 27 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.725849:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:3.0:1789403324.725852:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403324.725855:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947e00, rc 0) 00000100:00100000:3.0:1789403324.726193:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12384:x1876325038123136:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3261us (3397us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789403324.726203:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 203 00000100:00100000:1.0:1789403324.732672:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403324.736604:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038123264 00000100:00100000:2.0:1789403324.736620:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038123264 00000100:00100000:2.0:1789403324.736966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:2.0:1789403324.736979:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12384:x1876325038123264:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1789403324.737046:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737063:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737074:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737108:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737115:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737121:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737126:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403324.737130:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737168:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737187:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403324.737191:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403324.737196:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.737202:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b76192c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403324.737288:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12384:x1876325038123264:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 312us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403324.737296:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 204 00000100:00100000:1.0:1789403324.739374:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403324.739563:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038123520 00000100:00100000:3.0:1789403324.739573:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038123520 00000100:00100000:3.0:1789403324.739633:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1789403324.739643:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12384:x1876325038123520:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403324.739887:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+28:12384:x1876325038123520:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 244us (521us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789403324.739894:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:2.0:1789403324.805567:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403324.805664:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038123776 00000100:00100000:0.0:1789403324.805674:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038123776 00000100:00100000:0.0:1789403324.805781:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:0.0:1789403324.805792:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+28:11909:x1876325038123776:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403324.805826:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403324.805849:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b761933 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb1289fa expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.805966:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.805981:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 29 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.805990:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.806021:0:9061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 29 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.806035:0:9061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 29 pid: 13788 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403324.806049:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050759296:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403324.806287:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1789403324.817577:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403324.817625:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050759296:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403324.817653:0:9061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403324.825620:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038123904 00000100:00100000:3.0:1789403324.825635:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038123904 00010000:00010000:2.0:1789403324.825771:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 30 pid: 13788 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403324.825840:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 92 00000100:00100000:2.0:1789403324.825851:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:2389:x1876325038123904:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403324.825867:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403324.825874:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 30 pid: 13788 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.825887:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 30 pid: 13788 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.825933:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b76191e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289f3 expref: 30 pid: 13788 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.825964:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403324.825970:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.825979:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.825987:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.826019:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403324.826086:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:2389:x1876325038123904:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 236us (8520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403324.826094:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 92 00010000:00010000:1.0:1789403324.826261:0:9061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403324.826272:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403324.826290:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000004:00020000:1.0:1789403324.826306:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:1.0:1789403324.826462:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b761933 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 30 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403324.826479:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 29 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403324.826487:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:1.0:1789403324.826490:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403324.826492:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8000, rc 0) 00000100:00100000:1.0:1789403324.826530:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:11909:x1876325038123776:12345-192.168.203.43@tcp:101:bash.0 Request processed in 20740us (20973us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789403324.826537:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 205 00000100:00100000:2.0:1789403324.831435:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403324.831563:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038124032 00000100:00100000:3.0:1789403324.831573:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038124032 00000100:00100000:3.0:1789403324.831653:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:3.0:1789403324.831664:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:11909:x1876325038124032:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403324.831687:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403324.831706:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761948 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a01 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.831740:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b76194f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.831754:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b76194f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.831778:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b76194f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.831899:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a01 expref: 31 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.831920:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b76194f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a01 expref: 30 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.831928:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:3.0:1789403324.831931:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403324.831935:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947200, rc 0) 00000100:00100000:3.0:1789403324.832265:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11909:x1876325038124032:12345-192.168.203.43@tcp:101:bash.0 Request processed in 601us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403324.832274:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:3.0:1789403324.839546:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403324.840089:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038124288 00000100:00100000:2.0:1789403324.840098:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038124288 00000100:00100000:2.0:1789403324.840237:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 207 00000100:00100000:2.0:1789403324.840248:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:11909:x1876325038124288:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:2.0:1789403324.841328:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.841349:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.841381:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789403324.842088:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1789403324.842214:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e2bc923 reply state 000000001dbac36a transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.842230:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.842238:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403324.842241:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403324.842245:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789403324.842300:0:6501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789403324.843230:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:11909:x1876325038124288:12345-192.168.203.43@tcp:36:bash.0 Request processed in 2976us (3686us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789403324.843240:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 207 00000020:00080000:2.0:1789403324.843248:0:6501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789403324.849802:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403324.849886:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038124416 00000100:00100000:1.0:1789403324.849896:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038124416 00000100:00100000:1.0:1789403324.850057:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:1.0:1789403324.850069:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+34:11909:x1876325038124416:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403324.850120:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403324.850143:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76195d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a08 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403324.850214:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76195d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a08 expref: 35 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403324.850229:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76195d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a08 expref: 35 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403324.850248:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:1.0:1789403324.850251:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403324.850254:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04c00, rc 0) 00000100:00100000:1.0:1789403324.850318:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:11909:x1876325038124416:12345-192.168.203.43@tcp:101:bash.0 Request processed in 251us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403324.850324:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 208 00000100:00100000:3.0:1789403324.854588:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403324.854719:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038124544 00000100:00100000:2.0:1789403324.854730:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038124544 00000100:00100000:2.0:1789403324.854841:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:2.0:1789403324.854852:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:11909:x1876325038124544:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403324.854870:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403324.854891:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a0f expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403324.854919:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa820b9, atime: 0x6aa820b7, ctime: 0x6aa820b9, blocks: 0x8 00010000:00010000:2.0:1789403324.854961:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1789403324.854966:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403324.854975:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.854995:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.855007:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7200, rc 0) 00000100:00100000:2.0:1789403324.855074:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:11909:x1876325038124544:12345-192.168.203.43@tcp:101:bash.0 Request processed in 223us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403324.855081:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00080000:3.0:1789403324.855715:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403324.858378:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403324.859338:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038124672 00000100:00100000:0.0:1789403324.859348:0:8422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038124672 00002000:00010000:0.0:1789403324.859412:0:8422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789403324.859417:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a142501880 with x1876325038124672 ext(0->18446744073709551615) 00002000:00010000:0.0:1789403324.859429:0:8422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a142501880. 00000100:00100000:0.0:1789403324.859459:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1789403324.859473:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2387:x1876325038124672:12345-192.168.203.43@tcp:10:bash.0 00002000:00010000:0.0:1789403324.859800:0:8422:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789403324.859804:0:8422:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789403321 -> 1789403324 00002000:00010000:0.0:1789403324.859807:0:8422:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789403319 -> 1789403319 00002000:00010000:0.0:1789403324.859810:0:8422:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789403321 -> 1789403324 00002000:00010000:0.0:1789403324.859812:0:8422:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789403324.859877:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2387:x1876325038124672:12345-192.168.203.43@tcp:10:bash.0 Request processed in 404us (1504us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789403324.859886:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00002000:00010000:0.0:1789403324.859890:0:8422:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789403324.859893:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a142501880 with x1876325038124672 ext(0->18446744073709551615) 00002000:00010000:0.0:1789403324.859897:0:8422:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a142501880. 00010000:00010000:0.0:1789403324.913690:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403324.943250:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403324.943380:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038124800 00000100:00100000:3.0:1789403324.943429:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038124800 00000100:00100000:3.0:1789403324.943492:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:3.0:1789403324.943503:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:12398:x1876325038124800:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:3.0:1789403324.943573:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943590:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943602:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943616:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943623:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943630:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943710:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943719:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943726:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403324.943804:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943815:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943822:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943829:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943834:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403324.943838:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943846:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943858:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403324.943861:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403324.943866:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943872:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b76196b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943886:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943891:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943904:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943909:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403324.943912:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943918:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943926:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a1434a8c00) 00010000:00010000:3.0:1789403324.943928:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403324.943931:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.943936:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944307:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944381:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944692:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944699:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403324.944703:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944722:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944733:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:3.0:1789403324.944736:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403324.944739:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403324.944745:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403324.946195:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:12398:x1876325038124800:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 2684us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403324.946209:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 209 00000100:00100000:3.0:1789403324.977188:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403324.977301:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038125056 00000100:00100000:2.0:1789403324.977311:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038125056 00000100:00100000:2.0:1789403324.977375:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:2.0:1789403324.977384:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+35:12401:x1876325038125056:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403324.977444:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403324.977473:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761980 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a16 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977663:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977697:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977710:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977726:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977733:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977740:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.977934:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978008:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978018:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403324.978030:0:6501:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:2.0:1789403324.978035:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00020000:2.0:1789403324.978045:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:2.0:1789403324.978114:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978121:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978137:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978143:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403324.978148:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978156:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978167:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403324.978170:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403324.978174:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978181:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761987 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978195:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978202:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978207:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978212:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403324.978215:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978229:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978237:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:2.0:1789403324.978240:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403324.978243:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978249:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b76198e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978290:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761980 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a16 expref: 38 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978304:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a16 expref: 37 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403324.978311:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403324.978314:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789403324.978316:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6800, rc 0) 00000100:00100000:2.0:1789403324.979027:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:12401:x1876325038125056:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1640us (1844us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789403324.979037:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 210 00000100:00100000:1.0:1789403324.985432:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403324.985813:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038125184 00000100:00100000:0.0:1789403324.985824:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038125184 00000100:00100000:0.0:1789403324.986102:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:0.0:1789403324.986114:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:12401:x1876325038125184:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1789403324.986183:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.986200:0:9061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 37 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.986211:0:9061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.986247:0:9061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 37 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403324.986261:0:9061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 37 pid: 9061 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403324.986276:0:9061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050759424:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403324.986373:0:9061:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403324.994625:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403324.994822:0:9061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9061:1876325050759424:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403324.994859:0:9061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403324.995992:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038125440 00000100:00100000:3.0:1789403324.996003:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038125440 00000100:00100000:3.0:1789403324.996076:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1789403324.996087:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:6159:x1876325038125440:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789403324.997029:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:6159:x1876325038125440:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 287us (1755us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789403324.997040:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1789403324.999901:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.000032:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038125568 00000100:00100000:3.0:1789403325.000041:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038125568 00010000:00010000:3.0:1789403325.000082:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 39 pid: 9061 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.000126:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:3.0:1789403325.000137:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:2390:x1876325038125568:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403325.000153:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403325.000174:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 39 pid: 9061 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.000187:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 39 pid: 9061 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.000209:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b76193a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289fa expref: 39 pid: 9061 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.000225:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:3.0:1789403325.000230:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.000240:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.000248:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.000282:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403325.000435:0:9061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000443:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000489:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000504:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000511:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000518:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403325.000521:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000529:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000538:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:1.0:1789403325.000540:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403325.000544:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.000549:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b7619a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.000813:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:2390:x1876325038125568:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 676us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403325.000821:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 93 00000100:00100000:1.0:1789403325.006633:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:12401:x1876325038125184:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 20509us (21197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403325.006648:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 211 00000100:00100000:0.0:1789403325.011250:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.011346:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038125824 00000100:00100000:3.0:1789403325.011358:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038125824 00000100:00100000:3.0:1789403325.011474:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1789403325.011496:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+37:12401:x1876325038125824:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403325.011700:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:12401:x1876325038125824:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 217us (465us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789403325.011725:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00080000:0.0:1789403325.012320:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403325.100215:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.100609:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038126080 00000100:00100000:3.0:1789403325.100620:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038126080 00000100:00100000:3.0:1789403325.100685:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:3.0:1789403325.100696:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+38:12412:x1876325038126080:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:3.0:1789403325.100719:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403325.100739:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7619aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a1d expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.100824:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.100839:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101096:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101115:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101124:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101132:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101242:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b7619bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101272:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b7619bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101280:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b7619bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403325.101287:0:13788:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:3.0:1789403325.101293:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00000004:00020000:3.0:1789403325.101302:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023255553 00010000:00010000:3.0:1789403325.101366:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101373:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.101380:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102534:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403325.102549:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102561:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102576:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403325.102579:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403325.102584:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102592:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b7619b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102630:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102637:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102644:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102650:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403325.102653:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102659:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102668:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a1434a8c00) 00010000:00010000:3.0:1789403325.102670:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403325.102673:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102678:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b7619b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102735:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b7619aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a1d expref: 41 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102750:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b7619bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a1d expref: 40 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.102781:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:3.0:1789403325.102783:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403325.102786:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946400, rc 0) 00000100:00100000:3.0:1789403325.102962:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+40:12412:x1876325038126080:12345-192.168.203.43@tcp:101:cat.0 Request processed in 2266us (2756us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789403325.102971:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 212 00000100:00100000:2.0:1789403325.123285:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.123431:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038126336 00000100:00100000:3.0:1789403325.123441:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038126336 00000100:00100000:3.0:1789403325.123517:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:3.0:1789403325.123529:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+40:12412:x1876325038126336:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1789403325.123827:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+41:12412:x1876325038126336:12345-192.168.203.43@tcp:35:cat.0 Request processed in 299us (551us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789403325.123835:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1789403325.146661:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.148062:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038126592 00000100:00100000:2.0:1789403325.148076:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038126592 00000100:00100000:2.0:1789403325.148166:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 213 00000100:00100000:2.0:1789403325.148177:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+41:12413:x1876325038126592:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:2.0:1789403325.148231:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789403325.148257:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b76195d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a08 expref: 41 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148279:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b7619bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a1d expref: 40 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148293:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a16 expref: 39 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148316:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b76194f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a01 expref: 38 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148328:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403325.148333:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403325.148354:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148367:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148377:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148431:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148440:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148453:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148531:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148540:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148547:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403325.148775:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789403325.148785:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371147395843ns, next at 372147393411ns, rc = 0 00010000:00010000:2.0:1789403325.148831:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148840:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148849:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148856:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148862:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148868:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148900:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403325.148918:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148925:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148932:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.148937:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403325.148938:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403325.148945:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.148951:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403325.148954:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.148969:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.148979:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:1.0:1789403325.148991:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789403325.148996:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.149002:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b7619e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.149013:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403325.149014:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403325.149016:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403325.152136:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152157:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152175:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403325.152178:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789403325.152184:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152191:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7619db lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152220:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152227:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152233:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152261:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.152264:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152270:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152279:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403325.152282:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403325.152285:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152291:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7619cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403325.152303:0:6501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000042bc2a3 reply state 000000004e5c4648 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152316:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.152324:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:2.0:1789403325.152327:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403325.152330:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403325.152454:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:12413:x1876325038126592:12345-192.168.203.43@tcp:36:rm.0 Request processed in 4273us (5797us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789403325.152464:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 213 00000001:00080000:2.0:1789403325.171319:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789403325.171351:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1789403325.229729:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403325.229846:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038126848 00000100:00100000:1.0:1789403325.229855:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038126848 00000100:00100000:1.0:1789403325.229911:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:1.0:1789403325.229921:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+39:12419:x1876325038126848:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403325.229943:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403325.229964:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b7619e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a24 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.230599:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.230616:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.230628:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.230650:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.230658:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.230664:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403325.230962:0:9061:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789403325.231642:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231654:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231662:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403325.231669:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023256130 00000004:00020000:1.0:1789403325.231678:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199023256130 00010000:00010000:1.0:1789403325.231694:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231701:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231708:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231714:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403325.231718:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231734:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231747:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403325.231750:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403325.231765:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231772:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b7619f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403325.231786:0:9061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038d87a49 reply state 00000000498aa8c3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231796:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231802:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:1.0:1789403325.231805:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403325.231807:0:9061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789403325.231835:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b7619e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 42 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231848:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 41 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.231855:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:1.0:1789403325.231857:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403325.231859:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04c00, rc 0) 00000100:00100000:1.0:1789403325.231977:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12419:x1876325038126848:12345-192.168.203.43@tcp:101:bash.0 Request processed in 2057us (2257us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789403325.231999:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 214 00000100:00100000:3.0:1789403325.240547:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403325.240899:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038126976 00000100:00100000:0.0:1789403325.240911:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038126976 00000100:00100000:0.0:1789403325.241019:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1789403325.241031:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038126976:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403325.241055:0:8415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403325.241097:0:8415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a2b expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403325.241140:0:8415:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403325.241165:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789403325.241171:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403325.241182:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 6 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.241206:0:8415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 6 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.241224:0:8415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9200, rc 0) 00000100:00100000:0.0:1789403325.241304:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038126976:12345-192.168.203.43@tcp:101:bash.0 Request processed in 274us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.241311:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00080000:3.0:1789403325.242109:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403325.248339:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.248472:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038127104 00000100:00100000:2.0:1789403325.248496:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038127104 00000100:00100000:2.0:1789403325.248580:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:2.0:1789403325.248592:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:12419:x1876325038127104:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403325.248611:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.248631:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a32 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.248666:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.248676:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403325.248681:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403325.248687:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 7 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.248722:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.248737:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.248752:0:8416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8416:1876325050759552:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403325.248876:0:8416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403325.254019:0:8416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8416:1876325050759552:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403325.254057:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 7 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.254078:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7800, rc 0) 00000100:00100000:0.0:1789403325.254149:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:12419:x1876325038127104:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5558us (5824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.254158:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1789403325.254676:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.254768:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038127232 00000100:00100000:3.0:1789403325.254783:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038127232 00010000:00010000:3.0:1789403325.254839:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.254891:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:3.0:1789403325.254901:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038127232:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403325.254918:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403325.254949:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.254977:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.255004:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042304868/0x5fb08b1e5b761a0c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a2b expref: 7 pid: 8415 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.255021:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403325.255025:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403325.255034:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.255044:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.255087:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.255103:0:6486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6486:1876325050759680:192.168.203.43@tcp:105: 00000100:00100000:3.0:1789403325.255199:0:6486:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605000 going to sleep for 11 seconds 00000100:00100000:2.0:1789403325.259119:0:6486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6486:1876325050759680:192.168.203.43@tcp:105: 00010000:00010000:2.0:1789403325.259152:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403325.259261:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038127232:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 4359us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.259273:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 94 00000100:00100000:2.0:1789403325.261737:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.261843:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038127488 00000100:00100000:3.0:1789403325.261853:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038127488 00000100:00100000:3.0:1789403325.261913:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1789403325.261923:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+42:12419:x1876325038127488:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1789403325.262237:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:12419:x1876325038127488:12345-192.168.203.43@tcp:35:bash.0 Request processed in 315us (508us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789403325.262261:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1789403325.405613:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.405707:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038127616 00000100:00100000:3.0:1789403325.405724:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038127616 00000100:00100000:3.0:1789403325.405825:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:3.0:1789403325.405838:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+43:12435:x1876325038127616:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403325.405871:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403325.405899:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a39 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.405997:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761a21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.406015:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.406029:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403325.406080:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789403325.406085:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403325.406107:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.406159:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a39 expref: 45 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.406184:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a39 expref: 44 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.406214:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403325.406218:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403325.406222:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947000, rc 0) 00000100:00100000:3.0:1789403325.406306:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+44:12435:x1876325038127616:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 470us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403325.406325:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 215 00000100:00100000:0.0:1789403325.411894:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.412013:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038127872 00000100:00100000:2.0:1789403325.412026:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038127872 00000100:00100000:2.0:1789403325.412093:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:2.0:1789403325.412105:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+44:12435:x1876325038127872:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403325.412142:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.412168:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761a28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a40 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.412309:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761a2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.412326:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.412339:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403325.412352:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000004:00020000:2.0:1789403325.412362:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133187 00010000:00010000:2.0:1789403325.412803:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761a28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a40 expref: 47 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.412826:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761a2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a40 expref: 46 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.412835:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:2.0:1789403325.412848:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403325.412853:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6600, rc 0) 00000100:00100000:2.0:1789403325.412998:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+46:12435:x1876325038127872:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 894us (1117us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789403325.413007:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 216 00000100:00100000:2.0:1789403325.416588:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.416652:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.416826:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038128256 00000100:00100000:3.0:1789403325.416840:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038128256 00000100:00100000:3.0:1789403325.416925:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1789403325.416937:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a251b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+46:2388:x1876325038128256:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403325.416965:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403325.416995:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761a2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a40 expref: 46 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.417018:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:3.0:1789403325.417025:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403325.417100:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a251b1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+45:2388:x1876325038128256:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403325.417107:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403325.417273:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038128128 00000100:00100000:1.0:1789403325.417278:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038128128 00000100:00100000:1.0:1789403325.417321:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:1.0:1789403325.417329:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+45:12435:x1876325038128128:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403325.417352:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403325.417370:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761a3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a47 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.417538:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761a44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.417555:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761a44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.417567:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761a44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403325.417581:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000004:00020000:1.0:1789403325.417591:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2268287991810 00010000:00010000:1.0:1789403325.417723:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b761a3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a47 expref: 48 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.417740:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761a44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a47 expref: 47 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.417750:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:1.0:1789403325.417777:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789403325.417780:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05400, rc 0) 00000100:00100000:1.0:1789403325.417815:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:12435:x1876325038128128:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 487us (1242us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789403325.417821:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 217 00000100:00100000:1.0:1789403325.424659:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403325.424776:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038128384 00000100:00100000:0.0:1789403325.424789:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038128384 00000100:00100000:0.0:1789403325.424858:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:0.0:1789403325.424870:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+6:2390:x1876325038128384:12345-192.168.203.43@tcp:1:lfs.0 00010000:00010000:0.0:1789403325.424929:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.424964:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.424974:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403325.424978:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403325.424983:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.425025:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 6 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.425041:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 6 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403325.425057:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8415:1876325050759808:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403325.425178:0:8415:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403325.427458:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8415:1876325050759808:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403325.427502:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403325.428662:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.428767:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038128512 00000100:00100000:2.0:1789403325.428778:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038128512 00002000:00100000:2.0:1789403325.428840:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90a1443e4000 x1876325038128512/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:486/0 lens 504/0 e 0 to 0 dl 1789403336 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789403325.428852:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a1443e4000 with x1876325038128512 ext(0->8) 00010000:00010000:2.0:1789403325.428861:0:8421:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 7 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.428879:0:8421:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 7 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403325.428887:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a1443e4000 00000100:00100000:2.0:1789403325.428924:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1789403325.428935:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038128512:12345-192.168.203.43@tcp:4:lfs.0 00000100:00100000:2.0:1789403325.430379:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038128512:12345-192.168.203.43@tcp:4:lfs.0 Request processed in 1435us (1713us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789403325.430414:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00002000:00100000:2.0:1789403325.430428:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90a1443e4000 x1876325038128512/t4294967309(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:486/0 lens 504/448 e 0 to 0 dl 1789403336 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789403325.430474:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a1443e4000 with x1876325038128512 ext(0->8) 00010000:00010000:2.0:1789403325.430485:0:8421:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 9 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.430504:0:8421:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 9 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403325.430512:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90a1443e4000 00000100:00100000:2.0:1789403325.433535:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.434049:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038128640 00000100:00100000:3.0:1789403325.434062:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038128640 00010000:00010000:3.0:1789403325.434115:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 9 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.434216:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 95 00000100:00100000:3.0:1789403325.434240:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038128640:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403325.434260:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789403325.434286:0:10319:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789403325.434290:0:10319:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789403325 00002000:00010000:3.0:1789403325.434292:0:10319:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789403325 00002000:00010000:3.0:1789403325.434295:0:10319:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789403325 00002000:00010000:3.0:1789403325.434297:0:10319:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789403325.434305:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 9 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.434319:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 9 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.434347:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b761a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a32 expref: 9 pid: 8416 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.434369:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403325.434374:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403325.434381:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.434448:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.434489:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403325.434560:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038128640:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 322us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403325.434577:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 95 00010000:00010000:0.0:1789403325.434655:0:8415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434666:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434692:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434702:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434711:0:8415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434719:0:8415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403325.434724:0:8415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434733:0:8415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434747:0:8415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.434776:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a07ec1a6/0x5fb08b1e5b761a52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403325.434830:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038128384:12345-192.168.203.43@tcp:1:lfs.0 Request processed in 9962us (10184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.434838:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:2.0:1789403325.437366:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.437570:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038128896 00000100:00100000:3.0:1789403325.437583:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038128896 00000100:00100000:3.0:1789403325.437795:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:3.0:1789403325.437808:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+47:12435:x1876325038128896:12345-192.168.203.43@tcp:35:lfs.0 00000004:00010000:3.0:1789403325.437895:0:6502:0:(mdt_open.c:2006:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761a44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a47 expref: 47 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789403325.438214:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789403325.438252:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789403325.439189:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1789403325.439251:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.439274:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 51 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.439286:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.439338:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 51 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.439358:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 51 pid: 9061 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.439377:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6502:1876325050759936:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403325.439849:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403325.443232:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.443782:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038129024 00000100:00100000:2.0:1789403325.443795:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038129024 00010000:00010000:2.0:1789403325.443852:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 52 pid: 9061 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.443906:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 96 00000100:00100000:2.0:1789403325.443917:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:2390:x1876325038129024:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403325.443936:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403325.443954:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 52 pid: 9061 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.443968:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 52 pid: 9061 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.443995:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:2.0:1789403325.444002:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.444029:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.444038:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.444062:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403325.444253:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+52:2390:x1876325038129024:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 336us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.444261:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 96 00010000:00010000:3.0:1789403325.444662:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b7619fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a24 expref: 51 pid: 9061 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.444682:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6502:1876325050759936:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403325.444710:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.444773:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.444782:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789403325.444920:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1789403325.445063:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789403325.445171:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050760064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789403325.445239:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403325.445278:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605180 going to sleep for 11 seconds 00000100:00100000:0.0:1789403325.445423:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050760064 00000100:00100000:0.0:1789403325.445430:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050760064 00000100:00100000:0.0:1789403325.445494:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789403325.445503:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050760064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789403325.445610:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050760064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.445617:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1789403325.445830:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403325.445858:0:6502:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1789403325.445865:0:6502:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1789403325.445884:0:6502:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a1442ec000, transno 4294967308 00000100:00100000:3.0:1789403325.445904:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050760064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789403325.446081:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789403325.446135:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050760192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789403325.446166:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403325.446191:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403325.446322:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050760192 00000100:00100000:0.0:1789403325.446327:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050760192 00000100:00100000:0.0:1789403325.446359:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789403325.446367:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6502:x1876325050760192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789403325.446510:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6502:x1876325050760192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (343us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789403325.446518:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789403325.446827:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6502:1876325050760192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789403325.446888:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789403325.446923:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.446934:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.448111:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.448119:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403325.448124:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.448133:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.448152:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:3.0:1789403325.448156:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789403325.448162:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.448168:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789403325.448315:0:6502:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789403325.448405:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789403325.448418:0:6502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371447028600ns, next at 372447026122ns, rc = 0 00000001:00080000:3.0:1789403325.448427:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789403325.448763:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a142628e00) 00010000:00010000:3.0:1789403325.448768:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789403325.448791:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761a44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a47 expref: 55 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.449041:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:12435:x1876325038128896:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 11234us (11686us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789403325.449054:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000020:00080000:3.0:1789403325.449061:0:6502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789403325.451529:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.451634:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038129152 00000100:00100000:2.0:1789403325.451647:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038129152 00000100:00100000:2.0:1789403325.451750:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:2.0:1789403325.451770:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+54:12435:x1876325038129152:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403325.451801:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.451828:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761a60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a4e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.451902:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761a60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a4e expref: 55 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.451918:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761a60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a4e expref: 55 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.451947:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.451951:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403325.451955:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6400, rc 0) 00000100:00100000:2.0:1789403325.452080:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:12435:x1876325038129152:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 313us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.452088:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 218 00000100:00100000:0.0:1789403325.454888:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403325.455254:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038129408 00000100:00100000:1.0:1789403325.455268:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038129408 00000100:00100000:1.0:1789403325.455333:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1789403325.455346:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+55:12435:x1876325038129408:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403325.455800:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12435:x1876325038129408:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 456us (923us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789403325.455809:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1789403325.523300:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.523419:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038129536 00000100:00100000:2.0:1789403325.523431:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038129536 00000100:00100000:2.0:1789403325.523503:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:2.0:1789403325.523513:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12445:x1876325038129536:12345-192.168.203.43@tcp:34:lfs.0 00010000:00010000:2.0:1789403325.523859:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.523879:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.523892:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.523903:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.523911:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.523917:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524056:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524064:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524070:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403325.524145:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524160:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524168:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524175:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524181:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.524185:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524193:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524205:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403325.524208:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403325.524213:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524219:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7400/0x5fb08b1e5b761a67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524235:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524241:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524252:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524257:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.524260:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524266:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524273:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:2.0:1789403325.524275:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403325.524277:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524283:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761a6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524291:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524297:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524303:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524309:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.524311:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524324:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524331:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.524333:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403325.524336:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.524341:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.524568:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12445:x1876325038129536:12345-192.168.203.43@tcp:34:lfs.0 Request processed in 1054us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.524576:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 219 00000100:00100000:0.0:1789403325.554525:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.554772:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038129792 00000100:00100000:3.0:1789403325.554785:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038129792 00000100:00100000:3.0:1789403325.554861:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:3.0:1789403325.554874:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+56:12448:x1876325038129792:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403325.554902:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403325.554928:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a55 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555034:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555052:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555065:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555078:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555086:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555093:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555241:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555250:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555257:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403325.555265:0:13788:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613190145 00000004:00200000:3.0:1789403325.555272:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000004:00020000:3.0:1789403325.555281:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207613190145 00010000:00010000:3.0:1789403325.555376:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555385:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555453:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555459:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403325.555473:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555483:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555499:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403325.555502:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403325.555509:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555523:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761a83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555540:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555546:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555553:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555558:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403325.555560:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555566:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555573:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:3.0:1789403325.555576:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403325.555578:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555585:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761a8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555845:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761a7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 59 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555874:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 58 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.555883:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403325.555885:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403325.555888:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946400, rc 0) 00000100:00100000:3.0:1789403325.556024:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12448:x1876325038129792:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1152us (1513us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789403325.556033:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 220 00000100:00100000:0.0:1789403325.560297:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.560640:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038129920 00000100:00100000:2.0:1789403325.560653:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038129920 00000100:00100000:2.0:1789403325.560766:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:2.0:1789403325.560778:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12448:x1876325038129920:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1789403325.560862:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560883:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560897:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560940:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560959:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560966:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560973:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.560978:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.560987:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.561002:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.561006:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403325.561011:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.561017:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761a9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.561104:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12448:x1876325038129920:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 328us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.561112:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 221 00000100:00100000:1.0:1789403325.566635:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.566805:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038130176 00000100:00100000:3.0:1789403325.566818:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038130176 00000100:00100000:3.0:1789403325.566932:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:3.0:1789403325.566946:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+58:12448:x1876325038130176:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403325.567241:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:12448:x1876325038130176:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 298us (620us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789403325.567249:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1789403325.633540:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.633691:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038130432 00000100:00100000:2.0:1789403325.633705:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038130432 00000100:00100000:2.0:1789403325.633784:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:2.0:1789403325.633796:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:12458:x1876325038130432:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403325.633828:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.633846:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789403325.633881:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b761a21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a39 expref: 59 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.633905:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403325.633911:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403325.633927:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761aa6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a5c expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.634065:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.634081:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 59 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.634090:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.634129:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 59 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.634144:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 59 pid: 13788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.634160:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050760320:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403325.634271:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403325.637591:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050760320:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403325.637639:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403325.638090:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.638163:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038130560 00000100:00100000:2.0:1789403325.638172:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038130560 00010000:00010000:2.0:1789403325.638214:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 60 pid: 13788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.638257:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 97 00000100:00100000:2.0:1789403325.638268:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:2390:x1876325038130560:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403325.638287:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403325.638296:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 60 pid: 13788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.638309:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 60 pid: 13788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.638334:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946400/0x5fb08b1e5b761a91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a55 expref: 60 pid: 13788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.638352:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.638357:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.638369:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.638378:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.638437:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403325.638522:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:2390:x1876325038130560:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.638530:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 97 00010000:00010000:3.0:1789403325.638626:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.638634:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403325.638656:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000004:00020000:3.0:1789403325.638677:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:3.0:1789403325.638834:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761aa6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 60 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.638864:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 59 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.638871:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403325.638873:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789403325.638876:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6c00, rc 0) 00000100:00100000:3.0:1789403325.638905:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:12458:x1876325038130432:12345-192.168.203.43@tcp:101:bash.0 Request processed in 5112us (5382us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789403325.638913:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 222 00000100:00100000:0.0:1789403325.644306:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403325.644449:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038130688 00000100:00100000:1.0:1789403325.644463:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038130688 00000100:00100000:1.0:1789403325.644539:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:1.0:1789403325.644551:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+59:12458:x1876325038130688:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403325.644582:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403325.644617:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761abb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a63 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.644661:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.644678:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.644709:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.644857:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761abb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 61 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.644878:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 60 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.644887:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403325.644891:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403325.644895:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04c00, rc 0) 00000100:00100000:1.0:1789403325.644968:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:12458:x1876325038130688:12345-192.168.203.43@tcp:101:bash.0 Request processed in 420us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403325.644975:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 223 00000100:00100000:0.0:1789403325.648112:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.648264:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038130944 00000100:00100000:2.0:1789403325.648278:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038130944 00000100:00100000:2.0:1789403325.648345:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 224 00000100:00100000:2.0:1789403325.648358:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+60:12458:x1876325038130944:12345-192.168.203.43@tcp:36:bash.0 00010000:00010000:2.0:1789403325.648705:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.648726:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.648739:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789403325.648798:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789403325.648821:0:6500:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000deec7d5a reply state 00000000eb8571b7 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.648835:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.648843:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.648846:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403325.648851:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403325.648952:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12458:x1876325038130944:12345-192.168.203.43@tcp:36:bash.0 Request processed in 596us (851us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789403325.648960:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 224 00000020:00080000:2.0:1789403325.648967:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789403325.651997:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.652196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038131072 00000100:00100000:3.0:1789403325.652208:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038131072 00000100:00100000:3.0:1789403325.652313:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:3.0:1789403325.652325:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12458:x1876325038131072:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403325.652354:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403325.652379:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761ad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a6a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.652529:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.652547:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.652557:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.652597:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.652624:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 64 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.652642:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050760448:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403325.652733:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403325.655721:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050760448:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403325.655774:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.656664:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.656740:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038131200 00000100:00100000:3.0:1789403325.656749:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038131200 00010000:00010000:3.0:1789403325.656803:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 65 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403325.656847:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 98 00000100:00100000:3.0:1789403325.656860:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:2390:x1876325038131200:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403325.656878:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403325.656886:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 65 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.656900:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 65 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.656926:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761aad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a5c expref: 65 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.656969:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403325.656976:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.656985:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.656994:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403325.657172:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403325.657241:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:2390:x1876325038131200:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 382us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403325.657251:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 98 00010000:00010000:2.0:1789403325.659129:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.659150:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403325.659229:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789403325.659235:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403325.659264:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.659316:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946000/0x5fb08b1e5b761ad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.659342:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 63 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.659352:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.659355:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403325.659359:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947200, rc 0) 00000100:00100000:2.0:1789403325.659626:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12458:x1876325038131072:12345-192.168.203.43@tcp:101:bash.0 Request processed in 7300us (7639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.659635:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 225 00000100:00100000:2.0:1789403325.663147:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403325.663331:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038131456 00000100:00100000:1.0:1789403325.663343:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038131456 00000100:00100000:1.0:1789403325.663452:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1789403325.663474:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+63:12458:x1876325038131456:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:1.0:1789403325.663750:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12458:x1876325038131456:12345-192.168.203.43@tcp:35:bash.0 Request processed in 278us (612us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789403325.664030:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1789403325.682262:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403325.682291:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050760576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403325.682383:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403325.682608:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050760576 00000100:00100000:3.0:1789403325.682618:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050760576 00000100:00100000:3.0:1789403325.682684:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789403325.682695:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050760576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403325.682736:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789403325.682801:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050760576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403325.682808:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789403325.683051:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050760576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403325.721968:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403325.722506:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038131584 00000100:00100000:1.0:1789403325.722519:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038131584 00000100:00100000:1.0:1789403325.722634:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:1.0:1789403325.722646:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+64:12464:x1876325038131584:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403325.722678:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403325.722704:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761ade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a71 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.722798:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.722817:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.722831:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403325.722884:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789403325.722889:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403325.722912:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.722955:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761ade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a71 expref: 66 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.722978:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a71 expref: 65 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403325.722987:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403325.723007:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403325.723012:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04800, rc 0) 00000100:00100000:1.0:1789403325.723089:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038131584:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 446us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403325.723097:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 226 00000100:00100000:0.0:1789403325.731671:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403325.734866:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038131712 00000100:00100000:3.0:1789403325.734887:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038131712 00000100:00100000:2.0:1789403325.735346:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 227 00000100:00100000:2.0:1789403325.735359:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038131712:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403325.735416:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.735457:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761aec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a78 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735573:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735591:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735606:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735618:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735629:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735636:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735723:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735734:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735741:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403325.735804:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789403325.735810:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403325.735834:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735854:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735865:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735873:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735881:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735887:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.735892:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735901:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735915:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403325.735919:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403325.735924:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.735931:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761af3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736077:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736084:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736097:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736103:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403325.736106:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736112:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736120:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:2.0:1789403325.736122:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403325.736125:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736132:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761afa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736164:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761aec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a78 expref: 67 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736178:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a78 expref: 66 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.736185:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.736187:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403325.736190:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6800, rc 0) 00000100:00100000:2.0:1789403325.736330:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12464:x1876325038131712:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 973us (4673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.736345:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 227 00000100:00100000:3.0:1789403325.742671:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.742772:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038131840 00000100:00100000:2.0:1789403325.742787:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038131840 00000100:00100000:2.0:1789403325.742875:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1789403325.742886:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:2390:x1876325038131840:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403325.742905:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403325.742942:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a78 expref: 66 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.742966:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.742972:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403325.743050:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:2390:x1876325038131840:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 166us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.743058:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1789403325.743300:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.743612:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132096 00000100:00100000:2.0:1789403325.743619:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132096 00000100:00100000:2.0:1789403325.743653:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:2.0:1789403325.743660:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038132096:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403325.743683:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.743703:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a7f expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.743848:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.743864:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 66 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.743891:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.743931:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 66 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.743948:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 66 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.743964:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050760704:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403325.744044:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403325.747218:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403325.747305:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132224 00000100:00100000:0.0:1789403325.747317:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132224 00010000:00010000:0.0:1789403325.747372:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 67 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403325.747443:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 99 00000100:00100000:0.0:1789403325.747454:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:2389:x1876325038132224:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403325.747479:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403325.747486:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 67 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.747505:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 67 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.747538:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403325.747544:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.747556:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.747565:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.747612:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403325.747682:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:2389:x1876325038132224:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 224us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.747693:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 99 00010000:00010000:2.0:1789403325.748274:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947200/0x5fb08b1e5b761ad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a6a expref: 66 pid: 6501 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403325.748298:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050760704:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403325.748327:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.748337:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.748344:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403325.748368:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00020000:2.0:1789403325.750019:0:6501:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192008195 00010000:00010000:2.0:1789403325.750204:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 67 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.750255:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 66 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.750265:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.750269:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789403325.750272:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6000, rc 0) 00000100:00100000:2.0:1789403325.750337:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12464:x1876325038132096:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 6676us (7036us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789403325.750347:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 228 00000100:00100000:3.0:1789403325.753773:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403325.754941:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132480 00000100:00100000:0.0:1789403325.754957:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132480 00000100:00100000:0.0:1789403325.755034:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1789403325.755045:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a251b18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12464:x1876325038132480:12345-192.168.203.43@tcp:103:lfs.0 00010000:00010000:0.0:1789403325.755063:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403325.755093:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b761a60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a4e expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.755118:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403325.755123:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403325.755182:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a251b18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038132480:12345-192.168.203.43@tcp:103:lfs.0 Request processed in 139us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.755189:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403325.758956:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403325.759138:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132608 00000100:00100000:0.0:1789403325.759151:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132608 00000100:00100000:0.0:1789403325.759220:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:0.0:1789403325.759277:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038132608:12345-192.168.203.43@tcp:58:lfs.0 00010000:00010000:0.0:1789403325.759556:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.759577:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403325.759601:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403325.759794:0:9061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789403325.762205:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038132608:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 2917us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403325.762220:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 229 00000100:00100000:1.0:1789403325.766958:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403325.767997:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132736 00000100:00100000:2.0:1789403325.768012:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132736 00000100:00100000:2.0:1789403325.768087:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 230 00000100:00100000:2.0:1789403325.768099:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d160c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+65:12464:x1876325038132736:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403325.768123:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403325.768149:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a86 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.768213:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.768224:0:13788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 66 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.768245:0:13788:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.768259:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 66 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.768289:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403325.768292:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403325.768297:0:13788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 66 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403325.768305:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6c00, rc 0) 00000100:00100000:2.0:1789403325.768381:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d160c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12464:x1876325038132736:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 284us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403325.768427:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 230 00010000:00010000:3.0:1789403325.937905:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403326.129668:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403326.129682:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403326.129868:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789403326.129882:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403326.130055:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050760832:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789403326.130185:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403326.136191:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050760832:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789403326.136887:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.137190:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132864 00000100:00100000:2.0:1789403326.137201:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132864 00000100:00100000:2.0:1789403326.137277:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:2.0:1789403326.137288:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12465:x1876325038132864:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789403326.137330:0:6501:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789403326.137480:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12465:x1876325038132864:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 193us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.137488:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 231 00000100:00100000:3.0:1789403326.148069:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.148185:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038132992 00000100:00100000:0.0:1789403326.148198:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038132992 00000100:00100000:0.0:1789403326.148493:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:0.0:1789403326.148507:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12465:x1876325038132992:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789403326.148602:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.148625:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.148642:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.148681:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.148689:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.148696:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.152512:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.152545:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.152562:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403326.152641:0:9061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789403326.152647:0:9061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403326.153521:0:9061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153547:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153555:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153563:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153595:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403326.153601:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153609:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153629:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:0.0:1789403326.153633:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403326.153639:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153646:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153678:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153685:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153691:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153697:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403326.153700:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153707:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153727:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff90a243d8bd00) 00010000:00010000:0.0:1789403326.153730:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403326.153733:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153740:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9800/0x5fb08b1e5b761b32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153769:0:9061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153777:0:9061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153783:0:9061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153788:0:9061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403326.153791:0:9061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153797:0:9061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153806:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403326.153808:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403326.153811:0:9061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.153817:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b761b39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.154067:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12465:x1876325038132992:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 5549us (5998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.154080:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 232 00000100:00100000:3.0:1789403326.158637:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.158982:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038133248 00000100:00100000:2.0:1789403326.159006:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038133248 00000100:00100000:2.0:1789403326.159145:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:2.0:1789403326.159158:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+66:12465:x1876325038133248:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403326.159187:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403326.159212:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a8d expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159379:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159429:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159452:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403326.159466:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00020000:2.0:1789403326.159477:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:2.0:1789403326.159576:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159584:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159592:0:13788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159599:0:13788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.159604:0:13788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159613:0:13788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159628:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403326.159632:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789403326.159638:0:13788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159655:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159717:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b40 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a8d expref: 68 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159729:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:2.0:1789403326.159731:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403326.159735:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a8d expref: 68 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.159746:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6800, rc 0) 00000100:00100000:2.0:1789403326.159849:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12465:x1876325038133248:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 693us (1226us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789403326.159857:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 233 00000100:00100000:1.0:1789403326.164931:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.165104:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038133376 00000100:00100000:0.0:1789403326.165118:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038133376 00000100:00100000:0.0:1789403326.165517:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:0.0:1789403326.165531:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12465:x1876325038133376:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789403326.165576:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789403326.166104:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12465:x1876325038133376:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 573us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.166114:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 234 00000100:00100000:0.0:1789403326.196368:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403326.196416:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050760960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403326.196513:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403326.196723:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050760960 00000100:00100000:2.0:1789403326.196734:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050760960 00000100:00100000:2.0:1789403326.196813:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789403326.196825:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050760960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789403326.196856:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403326.196915:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050760960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.196923:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789403326.196976:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050760960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403326.197549:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050761216:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197588:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.197613:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050761728:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197632:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.197645:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050762240:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197663:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.197679:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789403326.197684:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050761088:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197711:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.197733:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050761600:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197780:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.197800:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050762112:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197823:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.197853:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761088 00000100:00100000:1.0:1789403326.197859:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761088 00000100:00100000:1.0:1789403326.197894:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789403326.197917:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050761088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.197961:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050761088:12345-0@lo:400:kworker.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.197967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789403326.198009:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761600 00000100:00100000:1.0:1789403326.198013:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761600 00000100:00100000:1.0:1789403326.198041:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789403326.198048:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050761600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.198081:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050761600:12345-0@lo:400:kworker.0 Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.198087:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789403326.198105:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050762112 00000100:00100000:1.0:1789403326.198108:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050762112 00000100:00100000:0.0:1789403326.198423:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050761344:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.198457:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.198477:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050761856:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.198500:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.198518:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050762368:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.198539:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.198559:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789403326.198565:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050761472:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.198585:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.198596:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050761984:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.198628:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.198646:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050762496:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.198666:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.198697:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761984 00000100:00100000:0.0:1789403326.198701:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761984 00000100:00100000:1.0:1789403326.198798:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050762496 00000100:00100000:1.0:1789403326.198803:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050762496 00000100:00100000:2.0:1789403326.198869:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761344 00000100:00100000:2.0:1789403326.198874:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761344 00000100:00100000:2.0:1789403326.198913:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789403326.198919:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050761344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403326.198964:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050761344:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.198970:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789403326.199021:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050761344:0@lo:400:kworker.0 00000100:00100000:2.0:1789403326.199045:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761216 00000100:00100000:2.0:1789403326.199049:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761216 00000100:00100000:2.0:1789403326.199069:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761728 00000100:00100000:2.0:1789403326.199072:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761728 00000100:00100000:3.0:1789403326.199188:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050762624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403326.199218:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403326.199248:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050762624 00000100:00100000:3.0:1789403326.199251:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050762624 00000100:00100000:3.0:1789403326.199277:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789403326.199284:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1876325050762624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403326.199298:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403326.199333:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1876325050762624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403326.199338:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789403326.199366:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050762624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403326.199386:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050762240 00000100:00100000:3.0:1789403326.199411:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050762240 00000100:00100000:0.0:1789403326.202918:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789403326.202936:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050762112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203050:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050762112:12345-0@lo:400:kworker.0 Request processed in 119us (5225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.203058:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789403326.203079:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789403326.203086:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050761984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203144:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050761984:12345-0@lo:400:kworker.0 Request processed in 58us (4514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.203150:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789403326.203184:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761856 00000100:00100000:0.0:1789403326.203193:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761856 00000100:00100000:0.0:1789403326.203221:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050762368 00000100:00100000:0.0:1789403326.203224:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050762368 00000100:00100000:0.0:1789403326.203239:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050761472 00000100:00100000:0.0:1789403326.203242:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050761472 00000100:00100000:0.0:1789403326.203256:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789403326.203262:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050761216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203298:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050761216:12345-0@lo:400:kworker.0 Request processed in 36us (5709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.203304:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789403326.203318:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789403326.203341:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050761856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203373:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050761856:12345-0@lo:400:kworker.0 Request processed in 32us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.203379:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789403326.203410:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789403326.203417:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050762368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203445:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050762368:12345-0@lo:400:kworker.0 Request processed in 29us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.203451:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789403326.203463:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789403326.203468:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050761472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203496:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050761472:12345-0@lo:400:kworker.0 Request processed in 28us (4909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.203501:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789403326.203590:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050761088:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203609:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050761600:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203625:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050762112:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203638:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050761216:0@lo:400:kworker.0 00000100:00080000:0.0:1789403326.203695:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403326.203701:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403326.203706:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403326.203709:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403326.203763:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050761472:0@lo:400:kworker.0 00000100:00100000:0.0:1789403326.203777:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050761984:0@lo:400:kworker.0 00010000:00080000:0.0:1789403326.203802:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e7100 x1876325050761856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403326.203814:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050761856:0@lo:400:kworker.0 00010000:00080000:0.0:1789403326.203826:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e7b80 x1876325050762368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403326.203835:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050762368:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.204643:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789403326.204655:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050762496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.204724:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050762496:12345-0@lo:400:kworker.0 Request processed in 71us (6055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.204731:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789403326.204779:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050762496:0@lo:400:kworker.0 00000100:00100000:2.0:1789403326.205215:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789403326.205235:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050761728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403326.205285:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050761728:12345-0@lo:400:kworker.0 Request processed in 61us (7652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.205291:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789403326.205323:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050761728:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.207136:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789403326.207153:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050762240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.207251:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050762240:12345-0@lo:400:kworker.0 Request processed in 104us (9585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.207258:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789403326.207437:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050762240:0@lo:400:kworker.0 00000100:00100000:1.0:1789403326.207696:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.207776:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038133632 00000100:00100000:2.0:1789403326.207785:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038133632 00000100:00100000:2.0:1789403326.207831:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:2.0:1789403326.207839:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12465:x1876325038133632:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403326.207856:0:9061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403326.207860:0:9061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789403326.207893:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761ae5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a71 expref: 67 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.207931:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:2.0:1789403326.207938:0:9061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403326.207955:0:9061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b55 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a94 expref: -99 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789403326.208484:0:9061:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789403326.208658:0:9061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.208675:0:9061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.208688:0:9061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403326.208695:0:9061:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:2.0:1789403326.208708:0:9061:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:2.0:1789403326.208764:0:9061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b761b55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a94 expref: 69 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.208782:0:9061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a94 expref: 68 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.208790:0:9061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01600) 00010000:00010000:2.0:1789403326.208793:0:9061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403326.208795:0:9061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7600, rc 0) 00000100:00100000:2.0:1789403326.208857:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:12465:x1876325038133632:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1018us (1163us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789403326.208877:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:2.0:1789403326.211814:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.211917:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038133888 00000100:00100000:1.0:1789403326.211929:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038133888 00000100:00100000:1.0:1789403326.212049:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:1.0:1789403326.212063:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:12465:x1876325038133888:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789403326.212134:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403326.212166:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b761b5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a94 expref: 68 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212189:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01600) 00010000:00010000:1.0:1789403326.212205:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403326.212230:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212246:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212256:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212272:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212280:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212287:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212337:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212362:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212369:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212375:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403326.212381:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212437:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212447:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403326.212450:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403326.212455:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212461:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212476:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212482:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212487:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212493:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403326.212502:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212509:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212517:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe6bdea25 (ffff90a142628d00) 00010000:00010000:1.0:1789403326.212520:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403326.212523:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.212529:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761b71 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe6bdea25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.212614:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12465:x1876325038133888:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 554us (811us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403326.212622:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:1.0:1789403326.214534:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.216629:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038134016 00000100:00100000:2.0:1789403326.216648:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038134016 00000100:00100000:2.0:1789403326.216729:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:2.0:1789403326.216744:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+67:12465:x1876325038134016:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403326.216781:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403326.216811:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761b78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128a9b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.216859:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.216876:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.216891:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.217362:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761b78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 69 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.217417:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 68 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.217427:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.217431:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403326.217445:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6a00, rc 0) 00000100:00100000:2.0:1789403326.217605:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:12465:x1876325038134016:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 863us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.217615:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:0.0:1789403326.228205:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403326.228319:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038134272 00000100:00100000:3.0:1789403326.228332:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038134272 00000100:00100000:3.0:1789403326.228528:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:3.0:1789403326.228543:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+68:12465:x1876325038134272:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789403326.228659:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.228682:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.228696:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403326.229586:0:13788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789403326.229603:0:13788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372228212953ns, next at 373228209348ns, rc = 0 00000004:00010000:2.0:1789403326.229672:0:13788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011867c07 reply state 0000000025ec859a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.229690:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.229698:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.229702:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789403326.229707:0:13788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403326.229965:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+70:12465:x1876325038134272:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 1424us (1771us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789403326.229974:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:3.0:1789403326.231799:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.232288:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038134400 00000100:00100000:1.0:1789403326.232300:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038134400 00000100:00100000:1.0:1789403326.232370:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:1.0:1789403326.232382:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+70:12465:x1876325038134400:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403326.232468:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403326.232496:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128aa2 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.232567:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 71 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.232582:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 71 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.232622:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:1.0:1789403326.232626:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403326.232630:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05000, rc 0) 00000100:00100000:1.0:1789403326.232708:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+71:12465:x1876325038134400:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 327us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.232716:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:1.0:1789403326.235540:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.235653:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038134528 00000100:00100000:0.0:1789403326.235665:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038134528 00000100:00100000:0.0:1789403326.235766:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:0.0:1789403326.235778:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038134528:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789403326.236067:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:2390:x1876325038134528:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 290us (537us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789403326.236075:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00080000:3.0:1789403326.236436:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403326.239197:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.239353:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038134784 00000100:00100000:1.0:1789403326.239365:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038134784 00000100:00100000:1.0:1789403326.239465:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403326.239476:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+71:12465:x1876325038134784:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789403326.239727:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+72:12465:x1876325038134784:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 252us (543us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789403326.239734:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1789403326.242637:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.242890:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135040 00000100:00100000:0.0:1789403326.242903:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135040 00000100:00100000:0.0:1789403326.243035:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:0.0:1789403326.243047:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+72:12465:x1876325038135040:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789403326.243194:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+72:12465:x1876325038135040:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 149us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.243202:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:2.0:1789403326.246053:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.246162:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135168 00000100:00100000:0.0:1789403326.246175:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135168 00000100:00100000:0.0:1789403326.246313:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 241 00000100:00100000:0.0:1789403326.246328:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+72:12465:x1876325038135168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403326.246353:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403326.246378:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128aa9 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.246490:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761b9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.246508:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.246523:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403326.246580:0:13788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403326.246770:0:13788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.246803:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b761b94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa9 expref: 74 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.246895:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761b9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa9 expref: 73 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.246905:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:0.0:1789403326.246908:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789403326.246912:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9e00, rc 0) 00000100:00100000:0.0:1789403326.247054:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+73:12465:x1876325038135168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 729us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.247073:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 241 00000100:00100000:2.0:1789403326.250235:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.250432:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135296 00000100:00100000:1.0:1789403326.250448:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135296 00000100:00100000:1.0:1789403326.250530:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:1.0:1789403326.250542:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+10:2389:x1876325038135296:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403326.250564:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403326.250591:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ab0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403326.250625:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa820be, blocks: 0x0 00010000:00010000:1.0:1789403326.250651:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1789403326.250672:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403326.250684:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 11 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.250709:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 11 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.250727:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04e00, rc 0) 00000100:00100000:1.0:1789403326.250806:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:2389:x1876325038135296:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 267us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.250826:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:2.0:1789403326.254298:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.254469:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135552 00000100:00100000:0.0:1789403326.254481:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135552 00000100:00100000:0.0:1789403326.254553:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:0.0:1789403326.254565:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+73:12465:x1876325038135552:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789403326.254697:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+73:12465:x1876325038135552:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 134us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.254706:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:2.0:1789403326.258499:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.258640:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135680 00000100:00100000:0.0:1789403326.258653:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135680 00000100:00100000:0.0:1789403326.258724:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:0.0:1789403326.258736:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+11:12465:x1876325038135680:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403326.258767:0:8563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403326.258792:0:8563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ab7 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.258844:0:8563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 12 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.258854:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403326.258859:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403326.258864:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 12 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.258906:0:8563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 12 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.258937:0:8563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 12 pid: 8416 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.258963:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8563:1876325050762752:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403326.259065:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed840 going to sleep for 11 seconds 00000100:00100000:2.0:1789403326.262563:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.262767:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135808 00000100:00100000:1.0:1789403326.262779:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135808 00010000:00010000:1.0:1789403326.262842:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 13 pid: 8416 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.262890:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:1.0:1789403326.262900:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:2389:x1876325038135808:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403326.262917:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403326.262946:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 13 pid: 8416 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.262962:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 13 pid: 8416 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.262994:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403326.263016:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403326.263027:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 13 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.263037:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 13 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.263084:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 13 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.263102:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6485:1876325050762880:192.168.203.43@tcp:105: 00000100:00100000:1.0:1789403326.263194:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789403326.264276:0:8563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b761ba2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab0 expref: 13 pid: 8416 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.264300:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8563:1876325050762752:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403326.264331:0:8563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 12 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.264344:0:8563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8c00, rc 0) 00000100:00100000:0.0:1789403326.264431:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:12465:x1876325038135680:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 5698us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.264440:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:2.0:1789403326.268618:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.268892:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038135936 00000100:00100000:1.0:1789403326.268904:0:8420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038135936 00000100:00100000:0.0:1789403326.269123:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6485:1876325050762880:192.168.203.43@tcp:105: 00010000:00010000:0.0:1789403326.269150:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1789403326.269257:0:8420:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff90a144466d80 x1876325038135936/t0(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:487/0 lens 504/0 e 0 to 0 dl 1789403337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789403326.269270:0:8420:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a144466d80 with x1876325038135936 ext(0->12) 00002000:00010000:1.0:1789403326.269277:0:8420:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a144466d80 00000100:00100000:3.0:1789403326.269341:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403326.269360:0:8422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2389:x1876325038135936:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789403326.269560:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2389:x1876325038135808:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 6660us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403326.269581:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 100 00000100:00100000:3.0:1789403326.270647:0:8422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:2389:x1876325038135936:12345-192.168.203.43@tcp:4:lhsmtool_posix.0 Request processed in 1288us (2036us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789403326.270659:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00002000:00100000:3.0:1789403326.270671:0:8422:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff90a144466d80 x1876325038135936/t4294967321(0) o4->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:487/0 lens 504/448 e 0 to 0 dl 1789403337 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789403326.270680:0:8422:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a144466d80 with x1876325038135936 ext(0->12) 00002000:00010000:3.0:1789403326.270685:0:8422:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a144466d80 00000100:00100000:2.0:1789403326.273893:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.274078:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038136064 00000100:00100000:0.0:1789403326.274091:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038136064 00000100:00100000:0.0:1789403326.274187:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 243 00000100:00100000:0.0:1789403326.274199:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+73:12465:x1876325038136064:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789403326.276225:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1789403326.276246:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789403326.276279:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789403326.276301:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a142605180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789403326.276306:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a142482400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a142605f00 00000020:00080000:3.0:1789403326.276310:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a142482500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a242e6ce00 00000004:00080000:3.0:1789403326.276332:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789403326.276356:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a281b1c240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789403326.276360:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a142482100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a281b1c180 00000020:00080000:3.0:1789403326.276362:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a142482600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a144457a00 00000020:00080000:3.0:1789403326.276374:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1789403326.276603:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276616:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276637:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276643:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.276648:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276657:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276676:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a2609b8500) 00010000:00010000:2.0:1789403326.276680:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403326.276686:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276693:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946800/0x5fb08b1e5b7618ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276745:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276761:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276768:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276773:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.276776:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276793:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276802:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a1434a8e00) 00010000:00010000:2.0:1789403326.276804:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403326.276807:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276823:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7a00/0x5fb08b1e5b761956 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276844:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276851:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276857:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276863:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.276865:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276872:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276879:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:2.0:1789403326.276882:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403326.276885:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276897:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6e00/0x5fb08b1e5b7619d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276918:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276925:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276931:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276936:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.276939:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276945:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276954:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a141a01300) 00010000:00010000:2.0:1789403326.276956:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403326.276959:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276964:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b7619f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276982:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.276999:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277014:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277020:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.277022:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277029:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277037:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403326.277040:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403326.277043:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277049:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b761ac9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277063:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277069:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277075:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277081:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.277084:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277100:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277110:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.277112:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789403326.277115:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.277120:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761b86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789403326.277444:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789403326.277600:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789403326.277613:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403326.277634:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050763008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789403326.277718:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.277989:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050763264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789403326.278022:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.278045:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403326.278051:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050763136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789403326.278072:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403326.278101:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050763008 00000100:00100000:0.0:1789403326.278109:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050763008 00000100:00100000:0.0:1789403326.278160:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050763264 00000100:00100000:0.0:1789403326.278163:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050763264 00000100:00100000:0.0:1789403326.278179:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050763136 00000100:00100000:0.0:1789403326.278181:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050763136 00000100:00100000:0.0:1789403326.278196:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403326.278205:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050763008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789403326.278251:0:8563:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1789403326.278290:0:8563:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa820bd, atime: 0x6aa820bd, ctime: 0x6aa820bd, blocks: 0x8 00010000:00010000:0.0:1789403326.278297:0:8563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.278316:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1789403326.278321:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403326.278328:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.278345:0:8563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.278369:0:8563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.278377:0:8563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.278417:0:8563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789403326.278582:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3628:x1876325050763008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 376us (863us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789403326.278590:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403326.278610:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789403326.278618:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050763264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789403326.278703:0:8563:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789403326.278707:0:8563:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789403326 00002000:00010000:0.0:1789403326.278710:0:8563:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789403326.278712:0:8563:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789403326 -> 1789403326 00002000:00010000:0.0:1789403326.278715:0:8563:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789403326.278757:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3627:x1876325050763264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (723us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789403326.278765:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789403326.278778:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789403326.278784:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050763136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789403326.278796:0:8563:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1789403326.278809:0:8563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403326.279183:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12465:x1876325038136064:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 4983us (5302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403326.279193:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 243 00000004:00080000:1.0:1789403326.279669:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a1442b4380/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789403326.279679:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050763008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789403326.279834:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403326.279844:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.279856:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403326.279861:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.279872:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.279896:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.279905:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c53f1154/0x5fb08b1e5b761bb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.279959:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403326.279962:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403326.279964:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403326.280683:0:8563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 12 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.280693:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789403326.280699:0:8563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789403326.280705:0:8563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.280758:0:8563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 12 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.280776:0:8563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 12 pid: 8416 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.280795:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8563:1876325050763392:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403326.280886:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed840 going to sleep for 11 seconds 00000004:00080000:0.0:1789403326.280927:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a143513100/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789403326.280946:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050763264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789403326.288318:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.288780:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8563:1876325050763392:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403326.288898:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.288944:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038136320 00000100:00100000:2.0:1789403326.288952:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038136320 00010000:00010000:2.0:1789403326.289010:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 13 pid: 8416 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.289054:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 101 00000100:00100000:2.0:1789403326.289065:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+13:2390:x1876325038136320:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403326.289083:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403326.289090:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 13 pid: 8416 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.289105:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 13 pid: 8416 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.289133:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b31ba87/0x5fb08b1e5b761964 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a0f expref: 13 pid: 8416 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.289152:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403326.289157:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403326.289163:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.289191:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.289363:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403326.289524:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2390:x1876325038136320:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 394us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.289533:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 101 00010000:00010000:0.0:1789403326.289643:0:8563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.289656:0:8563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.289672:0:8563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.289685:0:8563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.289694:0:8563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.289713:0:8563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789403326.290048:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038136192 00000100:00100000:1.0:1789403326.290056:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038136192 00000100:00100000:1.0:1789403326.290095:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:1.0:1789403326.290105:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+12:2390:x1876325038136192:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789403326.290862:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3627:x1876325050763136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12074us (12784us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789403326.290872:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1789403326.290904:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403326.290912:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.290924:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403326.290939:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.290951:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.290970:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.290990:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9e758bd/0x5fb08b1e5b761bb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.291015:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403326.291018:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403326.291020:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789403326.291063:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a143513480/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789403326.291071:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050763136:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789403326.295611:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1789403326.295635:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1789403326.295899:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038136192:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 5787us (7586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.296002:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 77 00000100:00100000:2.0:1789403326.302009:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.302108:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038136576 00000100:00100000:0.0:1789403326.302122:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038136576 00000100:00100000:0.0:1789403326.302809:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:0.0:1789403326.302831:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12465:x1876325038136576:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789403326.302899:0:13788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403326.302939:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761b9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa9 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.302961:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:0.0:1789403326.302968:0:13788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403326.303005:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.303023:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.303035:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403326.303229:0:13788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d07b3072 reply state 00000000b2b2b12c transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.303244:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.303250:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:0.0:1789403326.303252:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403326.303255:0:13788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789403326.303382:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:12465:x1876325038136576:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 554us (1449us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789403326.303416:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:3.0:1789403326.306542:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.306690:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038136704 00000100:00100000:1.0:1789403326.306701:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038136704 00000100:00100000:1.0:1789403326.306777:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:1.0:1789403326.306789:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038136704:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789403326.306990:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789403326.306994:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789403326 -> 1789403325 00002000:00010000:1.0:1789403326.306997:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789403325 00002000:00010000:1.0:1789403326.306999:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789403326 -> 1789403325 00002000:00010000:1.0:1789403326.307001:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789403326.307065:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038136704:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 277us (533us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789403326.307072:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 78 00000100:00100000:3.0:1789403326.310346:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.311272:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038136960 00000100:00100000:1.0:1789403326.311288:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038136960 00000100:00100000:1.0:1789403326.311361:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 245 00000100:00100000:1.0:1789403326.311372:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:12465:x1876325038136960:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789403326.311481:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.311501:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.311511:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.311567:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.311582:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 22 pid: 6500 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.311596:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050763520:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403326.311851:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403326.315639:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050763520:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403326.315881:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403326.316563:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.316720:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137088 00000100:00100000:0.0:1789403326.316795:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137088 00010000:00010000:1.0:1789403326.317346:0:10319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 23 pid: 6500 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.317412:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 102 00000100:00100000:1.0:1789403326.317425:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+23:2390:x1876325038137088:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403326.317443:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403326.317451:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 23 pid: 6500 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.317476:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 23 pid: 6500 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.317502:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b761b7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a9b expref: 23 pid: 6500 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.317538:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:1.0:1789403326.317544:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.317557:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.317566:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.317610:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403326.317686:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:2390:x1876325038137088:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 264us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.317694:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 102 00010000:00010000:2.0:1789403326.318169:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318181:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318240:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318249:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318257:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318264:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.318269:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318277:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318304:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.318306:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789403326.318311:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.318318:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04400/0x5fb08b1e5b761bc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.318377:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12465:x1876325038136960:12345-192.168.203.43@tcp:55:lhsmtool_posix.0 Request processed in 7006us (8043us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789403326.318415:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 245 00000100:00100000:3.0:1789403326.322556:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.322681:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137216 00000100:00100000:0.0:1789403326.322693:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137216 00000100:00100000:1.0:1789403326.322781:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:1.0:1789403326.322797:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2387:x1876325038137216:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789403326.322864:0:8415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.322888:0:8415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 8 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.322898:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403326.322904:0:8415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789403326.322910:0:8415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.322990:0:8415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 8 pid: 8563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.323007:0:8415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 8 pid: 8563 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.323024:0:8415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8415:1876325050763648:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403326.323126:0:8415:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403326.327349:0:8415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8415:1876325050763648:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403326.327435:0:8415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403326.328666:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.328770:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137344 00000100:00100000:0.0:1789403326.328782:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137344 00010000:00010000:0.0:1789403326.328842:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 9 pid: 8563 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.331374:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 103 00000100:00100000:2.0:1789403326.331415:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+9:2390:x1876325038137344:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403326.331442:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403326.331473:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 9 pid: 8563 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.331494:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 9 pid: 8563 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.331524:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c16ff0/0x5fb08b1e5b761ba9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ab7 expref: 9 pid: 8563 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.331546:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403326.331552:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403326.331559:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.331598:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.331643:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403326.331726:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038137344:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 338us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.331742:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 103 00010000:00010000:1.0:1789403326.332178:0:8415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332192:0:8415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332337:0:8415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332347:0:8415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332374:0:8415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332382:0:8415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403326.332416:0:8415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332428:0:8415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332444:0:8415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.332453:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b761bcc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.332525:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2387:x1876325038137216:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 9732us (9980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.332535:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:3.0:1789403326.340634:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.340784:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137600 00000100:00100000:0.0:1789403326.340800:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137600 00000100:00100000:0.0:1789403326.341016:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 246 00000100:00100000:0.0:1789403326.341029:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:12465:x1876325038137600:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789403326.341122:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.341151:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.341178:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.341228:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403326.341244:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 21 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.341260:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050763776:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403326.341354:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403326.344779:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050763776:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403326.344810:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.346883:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403326.347715:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137728 00000100:00100000:0.0:1789403326.347737:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137728 00010000:00010000:0.0:1789403326.347805:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.348103:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 104 00000100:00100000:1.0:1789403326.348125:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:2390:x1876325038137728:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403326.348155:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403326.348164:0:10319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348203:0:10319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348240:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761ac2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a63 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348260:0:10319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403326.348266:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348278:0:10319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348286:0:10319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348295:0:10319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.348350:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403326.348476:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:2390:x1876325038137728:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 361us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.348485:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 104 00010000:00010000:2.0:1789403326.348710:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.348719:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.348989:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.349004:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.349013:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.349051:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 21 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.349068:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 21 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.349101:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050763904:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403326.349176:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403326.356685:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.356833:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050763904:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403326.356860:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.358733:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137856 00000100:00100000:0.0:1789403326.358759:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137856 00010000:00010000:2.0:1789403326.358968:0:7451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.359010:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 105 00000100:00100000:2.0:1789403326.359019:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:2389:x1876325038137856:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403326.359034:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403326.359040:0:7451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.359053:0:7451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.359074:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761b8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aa2 expref: 22 pid: 6499 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.359091:0:7451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.359096:0:7451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.359148:0:7451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.359157:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.359187:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403326.359261:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:2389:x1876325038137856:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 243us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.359269:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 105 00010000:00010000:1.0:1789403326.359317:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.359335:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403326.359517:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789403326.359768:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789403326.359816:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789403326.360339:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050764032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789403326.360449:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.360486:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789403326.361074:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050764032 00000100:00100000:2.0:1789403326.361086:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050764032 00000100:00100000:2.0:1789403326.361142:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789403326.361152:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050764032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789403326.361289:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050764032:12345-0@lo:1000:mdt00_000.0 Request processed in 139us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.361296:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789403326.362169:0:6499:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789403326.362183:0:6499:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1789403326.362210:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a143513100, transno 4294967322 00000004:00080000:1.0:1789403326.362300:0:6499:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a143513480, transno 4294967323 00000100:00100000:1.0:1789403326.362311:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050764032:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789403326.362500:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789403326.364191:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050764160:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789403326.364303:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403326.364337:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403326.364429:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050764160 00000100:00100000:0.0:1789403326.364443:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050764160 00000100:00100000:0.0:1789403326.364506:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789403326.364519:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1876325050764160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789403326.365288:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1876325050764160:12345-0@lo:1000:mdt00_000.0 Request processed in 767us (979us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789403326.365301:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789403326.366277:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6499:1876325050764160:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789403326.366345:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366358:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366367:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366374:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.366479:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366489:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366509:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.366513:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403326.366520:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366527:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761bda lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366629:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366639:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366647:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366654:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.366658:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366666:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366676:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403326.366680:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789403326.366696:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366710:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366720:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.366777:0:6499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 24 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.366795:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050764288:192.168.203.43@tcp:105: 00000100:00100000:2.0:1789403326.367286:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403326.372728:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6499:1876325050764288:192.168.203.43@tcp:105: 00010000:00010000:2.0:1789403326.372785:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.372799:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b761b1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.372863:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.372879:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.372892:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.372926:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373059:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373069:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373075:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.373079:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373088:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373103:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403326.373107:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403326.373111:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373117:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b761be1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373129:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373135:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373141:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373152:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403326.373155:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373161:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373169:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403326.373172:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403326.373174:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.373180:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b761bd3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403326.373522:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403326.373544:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789403326.373624:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:12465:x1876325038137600:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 32594us (33690us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789403326.373639:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 246 00000020:00080000:2.0:1789403326.373647:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789403326.374300:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789403326.374312:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403326.379006:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.379177:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038137984 00000100:00100000:1.0:1789403326.379191:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038137984 00000100:00100000:1.0:1789403326.379257:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:1.0:1789403326.379268:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:12464:x1876325038137984:12345-192.168.203.43@tcp:49:lfs.0 00000100:00100000:1.0:1789403326.379559:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:12464:x1876325038137984:12345-192.168.203.43@tcp:49:lfs.0 Request processed in 292us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403326.379583:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1789403326.381618:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.382158:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038138240 00000100:00100000:1.0:1789403326.382172:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038138240 00000100:00100000:1.0:1789403326.382244:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:1.0:1789403326.382257:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+24:12465:x1876325038138240:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789403326.383229:0:6503:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789403326.383272:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1789403326.383317:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.383339:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.383353:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.383363:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.383369:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.383376:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.383444:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789403326.383568:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:12465:x1876325038138240:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1311us (1959us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789403326.383578:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000020:00080000:1.0:1789403326.383600:0:6503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789403326.386128:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403326.386146:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.386159:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403326.386169:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.386180:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.386225:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403326.386228:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789403326.386235:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.386241:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761be8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.386260:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403326.386261:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403326.386263:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403326.388201:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403326.388818:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038138496 00000100:00100000:3.0:1789403326.388833:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038138496 00000100:00100000:3.0:1789403326.388992:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 247 00000100:00100000:3.0:1789403326.389295:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:12464:x1876325038138496:12345-192.168.203.43@tcp:58:lfs.0 00000040:00080000:3.0:1789403326.389700:0:9061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789403326.389868:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:12464:x1876325038138496:12345-192.168.203.43@tcp:58:lfs.0 Request processed in 860us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403326.389877:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 247 00000100:00100000:0.0:1789403326.426681:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.426846:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038138624 00000100:00100000:1.0:1789403326.426859:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038138624 00000100:00100000:1.0:1789403326.426941:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 248 00000100:00100000:1.0:1789403326.426955:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+26:12467:x1876325038138624:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403326.426988:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403326.427015:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761bef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128abe expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427099:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427118:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427133:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427151:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427158:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427164:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427257:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427270:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427302:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427343:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403326.427359:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 27 pid: 6501 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403326.427375:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050764416:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403326.427527:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403326.431322:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403326.431654:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6501:1876325050764416:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403326.431696:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403326.431868:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038138880 00000100:00100000:0.0:1789403326.431878:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038138880 00000100:00100000:0.0:1789403326.431949:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:0.0:1789403326.431962:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+28:9914:x1876325038138880:12345-192.168.203.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789403326.432248:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:9914:x1876325038138880:12345-192.168.203.43@tcp:35:ldlm_bl.0 Request processed in 288us (942us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789403326.432257:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:0.0:1789403326.435562:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403326.435803:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038139008 00000100:00100000:2.0:1789403326.435817:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038139008 00010000:00010000:2.0:1789403326.435867:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 29 pid: 6501 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403326.435968:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 106 00000100:00100000:2.0:1789403326.435980:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a251b18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:2389:x1876325038139008:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403326.435999:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403326.436007:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 29 pid: 6501 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.436020:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 29 pid: 6501 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.436046:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b761b0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a7f expref: 29 pid: 6501 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.436088:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:2.0:1789403326.436094:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.436104:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.436112:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403326.436156:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403326.436219:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a251b18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+28:2389:x1876325038139008:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 241us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403326.436227:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 106 00010000:00010000:3.0:1789403326.436446:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436462:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403326.436537:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789403326.436543:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403326.436567:0:6501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436583:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436607:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436614:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436622:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436627:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403326.436632:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436641:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436651:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:3.0:1789403326.436654:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403326.436658:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436664:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b761bf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436699:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436705:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436711:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436716:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403326.436720:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436726:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436734:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a142628d00) 00010000:00010000:3.0:1789403326.436737:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403326.436740:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436754:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b761bfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436798:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b761bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128abe expref: 28 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436814:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128abe expref: 27 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403326.436832:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403326.436835:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403326.436837:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05000, rc 0) 00000100:00100000:3.0:1789403326.436877:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12467:x1876325038138624:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 9925us (10212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403326.436885:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 248 00010000:00010000:1.0:1789403326.962585:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403327.259196:0:14792:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789403327.259209:0:14792:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789403327.259244:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789403327.259251:0:14792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789403327.414559:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403327.414569:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403327.414597:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789403327.414606:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403327.415097:0:13777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050764544:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789403327.415227:0:13777:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a250707e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403327.423363:0:13777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143510380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13777:1876325050764544:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789403327.428205:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403327.428248:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038139136 00000100:00100000:1.0:1789403327.428259:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038139136 00000100:00100000:1.0:1789403327.428334:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:1.0:1789403327.428344:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12479:x1876325038139136:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789403327.428403:0:6499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789403327.428539:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12479:x1876325038139136:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 196us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403327.428547:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00080000:1.0:1789403327.428584:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403327.434246:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403327.434548:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038139392 00000100:00100000:0.0:1789403327.434560:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038139392 00000100:00100000:0.0:1789403327.434624:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 250 00000100:00100000:0.0:1789403327.434637:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+27:12479:x1876325038139392:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403327.434728:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403327.434767:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b761c0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ac5 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403327.434900:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b761c12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403327.434930:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b761c12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403327.434946:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b761c12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403327.434960:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00020000:0.0:1789403327.434971:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:0.0:1789403327.435208:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b761c0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ac5 expref: 30 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403327.435227:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b761c12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ac5 expref: 29 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403327.435236:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403327.435240:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403327.435244:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9000, rc 0) 00000100:00100000:0.0:1789403327.435326:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:12479:x1876325038139392:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 692us (1094us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789403327.435342:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 250 00000100:00100000:1.0:1789403327.441689:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403327.441928:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038139648 00000100:00100000:3.0:1789403327.441943:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038139648 00000100:00100000:3.0:1789403327.442025:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:3.0:1789403327.442037:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:12479:x1876325038139648:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789403327.442156:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442179:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442194:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442416:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442444:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442452:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442457:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403327.442463:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442472:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442487:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:3.0:1789403327.442490:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403327.442497:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403327.442503:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403327.442725:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403327.442731:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403327.443253:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789403327.443265:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789403327.444984:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:12479:x1876325038139648:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 2936us (3297us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789403327.445001:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:2.0:1789403327.445601:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403327.446803:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038139776 00000100:00100000:0.0:1789403327.446818:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038139776 00000100:00100000:0.0:1789403327.446941:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403327.446953:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:2389:x1876325038139776:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403327.446988:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403327.447017:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9000/0x5fb08b1e5b761c12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ac5 expref: 30 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403327.447038:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403327.447044:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403327.447114:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:2389:x1876325038139776:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 165us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403327.447122:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1789403327.452645:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403327.452749:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140032 00000100:00100000:0.0:1789403327.452762:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140032 00000100:00100000:0.0:1789403327.452823:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:0.0:1789403327.452834:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+29:12479:x1876325038140032:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789403327.453184:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:12479:x1876325038140032:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 351us (550us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789403327.453192:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00010000:00010000:2.0:1789403327.986003:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403329.019217:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403329.098296:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403329.098344:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403329.098373:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403329.098447:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140672 00000100:00100000:3.0:1789403329.098448:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140160 00000100:00100000:3.0:1789403329.098459:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140160 00000100:00100000:0.0:1789403329.098459:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140672 00000100:00100000:3.0:1789403329.098521:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 390 00000100:00100000:0.0:1789403329.098522:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:0.0:1789403329.098537:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038140672:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403329.098539:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038140160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403329.098618:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038140672:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403329.098625:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038140160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 87us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403329.098631:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:3.0:1789403329.098644:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 390 00000100:00100000:1.0:1789403329.098666:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403329.098699:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140416 00000100:00100000:3.0:1789403329.098701:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140928 00000100:00100000:1.0:1789403329.098704:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140416 00000100:00100000:3.0:1789403329.098708:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140928 00000100:00100000:1.0:1789403329.098759:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 332 00000100:00100000:1.0:1789403329.098771:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038140416:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403329.098776:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 333 00000100:00100000:3.0:1789403329.098788:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038140928:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403329.098811:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2389:x1876325038140416:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403329.098820:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 332 00000100:00100000:3.0:1789403329.098826:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038140928:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403329.098834:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 333 00000100:00080000:1.0:1789403329.098845:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403329.098852:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403329.099282:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403329.099310:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403329.099348:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403329.099371:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140288 00000100:00100000:1.0:1789403329.099375:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140544 00000100:00100000:3.0:1789403329.099378:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140288 00000100:00100000:1.0:1789403329.099381:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140544 00000100:00100000:3.0:1789403329.099446:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038140800 00000100:00100000:3.0:1789403329.099451:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038140800 00000100:00100000:3.0:1789403329.099605:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 334 00000100:00100000:3.0:1789403329.099612:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:2389:x1876325038140288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403329.099619:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1789403329.099629:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038140544:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403329.099651:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:2389:x1876325038140288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403329.099656:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 334 00000100:00100000:1.0:1789403329.099664:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2389:x1876325038140544:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403329.099671:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 335 00000100:00100000:1.0:1789403329.099675:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:3.0:1789403329.099680:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038140800:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403329.099705:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2389:x1876325038140800:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403329.099710:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 335 00000100:00080000:3.0:1789403329.099797:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403329.099800:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789403329.118095:0:14843:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789403329.118109:0:14843:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789403329.118139:0:14843:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789403329.118144:0:14843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789403329.267773:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050764672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403329.267840:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403329.270289:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050764672 00000100:00100000:0.0:1789403329.270304:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050764672 00000100:00100000:0.0:1789403329.270384:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789403329.270414:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050764672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789403329.270444:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789403329.270518:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050764672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403329.270525:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1789403329.270548:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403329.271749:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050764800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403329.271801:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403329.271856:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050764800 00000100:00100000:2.0:1789403329.271862:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050764800 00000100:00100000:2.0:1789403329.271911:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789403329.271920:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050764800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403329.271935:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789403329.271972:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050764800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403329.271978:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789403329.272033:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050764800:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789403329.272051:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403329.273705:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050764672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403329.302535:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403329.302702:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141184 00000100:00100000:0.0:1789403329.302712:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141184 00000100:00100000:0.0:1789403329.302781:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:0.0:1789403329.302792:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+30:12500:x1876325038141184:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403329.302814:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403329.302835:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761c27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128acc expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.302947:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761c2e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.302963:0:13788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761c2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.302976:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761c2e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403329.302987:0:13788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00020000:0.0:1789403329.302997:0:13788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2208192004097 00010000:00010000:0.0:1789403329.303095:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b761c27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128acc expref: 33 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.303701:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761c2e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128acc expref: 32 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.303711:0:13788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403329.303714:0:13788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789403329.303717:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8e00, rc 0) 00000100:00100000:2.0:1789403329.305978:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:12500:x1876325038141184:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 3178us (3442us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789403329.305991:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:3.0:1789403329.310640:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403329.310757:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141312 00000100:00100000:0.0:1789403329.310768:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141312 00000100:00100000:0.0:1789403329.310839:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:0.0:1789403329.310850:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:12500:x1876325038141312:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:0.0:1789403329.310920:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.310950:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.310963:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.310997:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.311004:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.311012:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.311018:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403329.311036:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.311045:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.311057:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:0.0:1789403329.311061:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789403329.311065:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.311073:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b761c3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403329.311149:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+32:12500:x1876325038141312:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 301us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403329.311157:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:3.0:1789403329.422498:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403329.422954:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141440 00000100:00100000:0.0:1789403329.422963:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141440 00000100:00100000:0.0:1789403329.423066:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1789403329.423076:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038141440:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1789403329.423093:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403329.423112:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b761c43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ad3 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403329.423137:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa820bd, atime: 0x6aa820bd, ctime: 0x6aa820bd, blocks: 0x8 00010000:00010000:0.0:1789403329.423156:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1789403329.423161:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403329.423169:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b761c43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ad3 expref: 8 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.423200:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b761c43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ad3 expref: 8 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403329.423214:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8a00, rc 0) 00000100:00100000:0.0:1789403329.423274:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2390:x1876325038141440:12345-192.168.203.43@tcp:101:cat.0 Request processed in 200us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403329.423282:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:1.0:1789403329.431481:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403329.431579:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141568 00000100:00100000:2.0:1789403329.431590:0:8421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141568 00002000:00100000:2.0:1789403329.431640:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff90a1442ed180 x1876325038141568/t0(0) o3->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:490/0 lens 488/0 e 0 to 0 dl 1789403340 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789403329.431652:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a1442ed180 with x1876325038141568 ext(0->4095) 00002000:00010000:2.0:1789403329.431658:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a1442ed180 00000100:00100000:2.0:1789403329.431688:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403329.431698:0:8421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038141568:12345-192.168.203.43@tcp:3:cat.0 00000100:00100000:2.0:1789403329.431882:0:8421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+8:2389:x1876325038141568:12345-192.168.203.43@tcp:3:cat.0 Request processed in 185us (412us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789403329.431890:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00002000:00100000:2.0:1789403329.431897:0:8421:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff90a1442ed180 x1876325038141568/t0(0) o3->fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4@192.168.203.43@tcp:490/0 lens 488/4536 e 0 to 0 dl 1789403340 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789403329.431906:0:8421:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90a1442ed180 with x1876325038141568 ext(0->4095) 00002000:00010000:2.0:1789403329.431909:0:8421:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a1442ed180 00000040:00080000:0.0:1789403329.521614:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403329.521624:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403329.521646:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789403329.521657:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789403329.778217:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050764928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403329.778294:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403329.778655:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050764928 00000100:00100000:3.0:1789403329.778670:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050764928 00000100:00100000:3.0:1789403329.778746:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789403329.778757:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050764928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403329.778792:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403329.778862:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050764928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403329.778872:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789403329.778982:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050764928:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789403329.970216:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403330.033515:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403330.803364:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403330.803404:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050765056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403330.803485:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403330.803554:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765056 00000100:00100000:2.0:1789403330.803574:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765056 00000100:00100000:2.0:1789403330.803620:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789403330.803628:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050765056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403330.803660:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789403330.803729:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050765056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403330.803737:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789403330.803785:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050765056:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1789403330.816693:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789403330.816722:0:9495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:0.0:1789403331.057677:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403331.313625:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050765184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403331.313695:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403331.313753:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050765312:0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.313770:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050765696:0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.313801:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403331.313828:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403331.313848:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050765568:0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.313893:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403331.313914:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403331.313921:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050765440:0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.313940:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403331.313988:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765184 00000100:00100000:0.0:1789403331.313995:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765184 00000100:00100000:0.0:1789403331.314048:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789403331.314057:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050765184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403331.314086:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403331.314131:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050765184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.314137:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789403331.314160:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765696 00000100:00100000:0.0:1789403331.314164:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765696 00000100:00100000:0.0:1789403331.314188:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765440 00000100:00100000:0.0:1789403331.314193:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765440 00000100:00100000:0.0:1789403331.314211:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789403331.314217:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050765696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.314248:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050765696:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.314255:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789403331.314267:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789403331.314273:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050765440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.314302:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050765440:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.314309:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789403331.314345:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050765440:0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.314373:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050765696:0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.314405:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050765184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403331.319043:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050765824:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.319120:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319188:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050766080:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.319217:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050766336:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319227:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319252:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050766592:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319275:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319294:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789403331.319300:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050765952:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319319:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319337:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050766464:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319362:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403331.319377:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319409:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766080 00000100:00100000:3.0:1789403331.319418:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766080 00000100:00100000:2.0:1789403331.319435:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789403331.319443:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050766208:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319480:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766592 00000100:00100000:2.0:1789403331.319482:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319487:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766592 00000100:00100000:3.0:1789403331.319507:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765952 00000100:00100000:3.0:1789403331.319509:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765952 00000100:00100000:3.0:1789403331.319520:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766464 00000100:00100000:3.0:1789403331.319522:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766464 00000100:00100000:3.0:1789403331.319535:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789403331.319542:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050766080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319595:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050766080:12345-0@lo:400:kworker.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403331.319604:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789403331.319618:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050766720:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319625:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789403331.319634:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050766592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.319648:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403331.319676:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050766592:12345-0@lo:400:kworker.0 Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403331.319683:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789403331.319698:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789403331.319706:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050765952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.319729:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765312 00000100:00100000:2.0:1789403331.319735:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765312 00000100:00100000:3.0:1789403331.319754:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050765952:12345-0@lo:400:kworker.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403331.319761:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789403331.319775:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789403331.319785:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.319810:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050766464:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403331.319815:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789403331.319880:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789403331.319893:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050765312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.319897:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766336 00000100:00100000:0.0:1789403331.319910:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766336 00000100:00100000:2.0:1789403331.319931:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3629:x1876325050765312:12345-0@lo:400:kworker.0 Request processed in 40us (6102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.319943:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766208 00000100:00100000:0.0:1789403331.319948:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766208 00000100:00100000:0.0:1789403331.319970:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766720 00000100:00100000:0.0:1789403331.319973:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766720 00000100:00100000:0.0:1789403331.319989:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789403331.319995:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050766336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.320030:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050766336:12345-0@lo:400:kworker.0 Request processed in 35us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.320037:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789403331.320048:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789403331.320053:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050766208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.320079:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050766208:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.320085:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789403331.320095:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789403331.320111:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050766720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.320136:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050766720:12345-0@lo:400:kworker.0 Request processed in 37us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403331.320143:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789403331.320162:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765568 00000100:00100000:0.0:1789403331.320163:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403331.320170:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765568 00000100:00100000:0.0:1789403331.320175:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050766848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403331.320203:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050765824 00000100:00100000:0.0:1789403331.320205:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403331.320233:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766848 00000100:00100000:0.0:1789403331.320237:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766848 00000100:00100000:0.0:1789403331.320262:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789403331.320268:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050766848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403331.320292:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403331.320326:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050766848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403331.320328:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050765824 00000100:00100000:0.0:1789403331.320336:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789403331.320357:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789403331.320367:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050765568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403331.320377:0:3628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789403331.320385:0:3628:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789403331.320424:0:3628:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a1442b4380, transno 4294967311 00000100:00100000:0.0:1789403331.320442:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050766848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403331.320614:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050765568:12345-0@lo:400:kworker.0 Request processed in 248us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403331.320622:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789403331.320640:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789403331.320647:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403331.320679:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050765824:12345-0@lo:400:kworker.0 Request processed in 34us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403331.320685:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1789403331.321746:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403331.321755:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403331.321758:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403331.321760:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403331.323508:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050765952:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.323536:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050766464:0@lo:400:kworker.0 00010000:00080000:3.0:1789403331.323549:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442ec000 x1876325050766080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403331.323559:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050766080:0@lo:400:kworker.0 00010000:00080000:3.0:1789403331.323569:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442edc00 x1876325050766592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403331.323577:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050766592:0@lo:400:kworker.0 00000100:00100000:3.0:1789403331.323589:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050765568:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.323604:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789403331.323668:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050766208:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.323681:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.323691:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050765824:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.323702:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050766336:0@lo:400:kworker.0 00000100:00100000:2.0:1789403331.323724:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050765312:0@lo:400:kworker.0 00000001:00080000:0.0:1789403331.324039:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789403331.324067:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a14259c000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789403331.324071:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a1431ce600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a14259c180 00000020:00080000:0.0:1789403331.324074:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a1431ce300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a14359ae00 00000020:00080000:0.0:1789403331.324096:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1789403331.324309:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403331.324320:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403331.324329:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403331.324335:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403331.324340:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403331.324347:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403331.324361:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a141a01800) 00010000:00010000:2.0:1789403331.324364:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403331.324369:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403331.324413:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b761bbe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13788 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789403331.324533:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789403331.324608:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1789403331.829290:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1789403331.829304:0:8409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1789403332.085245:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403333.106186:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403334.130947:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403334.220568:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403334.220623:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403334.220664:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403334.220674:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141696 00000100:00100000:3.0:1789403334.220685:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141696 00000100:00100000:1.0:1789403334.220713:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403334.220733:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403334.220753:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403334.220800:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403334.220841:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 392 00000100:00100000:3.0:1789403334.220851:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2390:x1876325038141696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403334.220884:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141952 00000100:00100000:0.0:1789403334.220890:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141952 00000100:00100000:0.0:1789403334.220941:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142464 00000100:00100000:0.0:1789403334.220945:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142464 00000100:00100000:0.0:1789403334.220962:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038141824 00000100:00100000:0.0:1789403334.220964:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038141824 00000100:00100000:0.0:1789403334.220976:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142336 00000100:00100000:0.0:1789403334.220978:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142336 00000100:00100000:0.0:1789403334.221004:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 342 00000100:00100000:0.0:1789403334.221011:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038141952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403334.221076:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038141952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403334.221084:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 342 00000100:00100000:0.0:1789403334.221102:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 343 00000100:00100000:0.0:1789403334.221109:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038142464:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403334.221134:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038142464:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403334.221141:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 343 00000100:00100000:0.0:1789403334.221153:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 344 00000100:00100000:0.0:1789403334.221159:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038141824:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403334.221184:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2390:x1876325038141824:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403334.221191:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 344 00000100:00100000:0.0:1789403334.221202:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 345 00000100:00100000:0.0:1789403334.221209:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038142336:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403334.221234:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2390:x1876325038142336:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403334.221242:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 345 00000100:00100000:3.0:1789403334.221259:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:166878b2-2dd8-4b83-a3c7-759691277065+13:2390:x1876325038141696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 407us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403334.221267:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 392 00000100:00100000:0.0:1789403334.221272:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142208 00000100:00100000:0.0:1789403334.221278:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142208 00000100:00100000:0.0:1789403334.221312:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142080 00000100:00100000:0.0:1789403334.221316:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142080 00000100:00100000:0.0:1789403334.221359:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1789403334.221366:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038142208:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403334.221428:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2390:x1876325038142208:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 61us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403334.221429:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:0.0:1789403334.221441:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:3.0:1789403334.221455:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038142080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403334.221490:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2390:x1876325038142080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 50us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403334.221497:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00080000:1.0:1789403334.221695:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789403334.221700:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403334.221703:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403334.221704:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403334.385790:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050766976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403334.385861:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403334.386042:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050766976 00000100:00100000:2.0:1789403334.386051:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050766976 00000100:00100000:2.0:1789403334.386117:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789403334.386127:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050766976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403334.386155:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789403334.386202:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050766976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403334.386208:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789403334.386254:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050766976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789403334.386475:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403334.388442:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403334.388462:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050767104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403334.388525:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403334.389095:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767104 00000100:00100000:0.0:1789403334.389105:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767104 00000100:00100000:0.0:1789403334.389210:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789403334.389220:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050767104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789403334.389242:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789403334.389298:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050767104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403334.389306:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789403334.389359:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403334.391566:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789403334.391595:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789403334.391634:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050767104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403334.468517:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403334.472014:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142592 00000100:00100000:0.0:1789403334.472028:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142592 00000100:00100000:0.0:1789403334.472114:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:0.0:1789403334.472125:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:12145:x1876325038142592:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789403334.472245:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:12145:x1876325038142592:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 122us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403334.472253:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:0.0:1789403334.482641:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403334.482744:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142720 00000100:00100000:2.0:1789403334.482753:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142720 00000100:00100000:2.0:1789403334.482808:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00100000:2.0:1789403334.482818:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:12145:x1876325038142720:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789403334.482935:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:12145:x1876325038142720:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403334.482942:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 255 00000100:00100000:1.0:1789403334.490286:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403334.490479:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038142976 00000100:00100000:2.0:1789403334.490488:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038142976 00000100:00100000:3.0:1789403334.490753:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:3.0:1789403334.490765:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:12145:x1876325038142976:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789403334.491103:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:12145:x1876325038142976:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 339us (825us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789403334.491112:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:2.0:1789403334.897727:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050767232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403334.897835:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403334.899059:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767232 00000100:00100000:3.0:1789403334.899072:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767232 00000100:00100000:3.0:1789403334.899194:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789403334.899205:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050767232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403334.899240:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789403334.911229:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050767232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12017us (13384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403334.911246:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789403334.914628:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050767232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403335.154508:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403335.925406:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403335.925430:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050767360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403335.925497:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403335.925768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767360 00000100:00100000:0.0:1789403335.925784:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767360 00000100:00100000:0.0:1789403335.925831:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789403335.925839:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050767360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403335.925872:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789403335.925934:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050767360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403335.925941:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789403335.927123:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050767360:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403336.189303:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403336.436464:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050767488:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436536:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436584:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050768000:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436611:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436634:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436659:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436691:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050769024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436712:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436738:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789403336.436744:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050767616:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436789:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436809:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050768128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436831:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436847:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436870:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436902:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050767744:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436927:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436943:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050768256:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.436963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.436993:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050768768:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437013:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.437030:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789403336.437035:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050767872:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437054:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.437065:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050768384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437102:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.437120:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050768896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403336.437172:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767488 00000100:00100000:1.0:1789403336.437180:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767488 00000100:00100000:1.0:1789403336.437224:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789403336.437233:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437282:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050767488:12345-0@lo:400:kworker.0 Request processed in 50us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437289:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789403336.437322:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768000 00000100:00100000:1.0:1789403336.437326:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768000 00000100:00100000:1.0:1789403336.437349:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767744 00000100:00100000:1.0:1789403336.437352:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767744 00000100:00100000:1.0:1789403336.437367:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789403336.437373:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050768000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437431:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050768000:12345-0@lo:400:kworker.0 Request processed in 57us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437438:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789403336.437451:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789403336.437457:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437500:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050767744:12345-0@lo:400:kworker.0 Request processed in 43us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437507:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789403336.437526:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768512 00000100:00100000:1.0:1789403336.437530:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768512 00000100:00100000:1.0:1789403336.437557:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769024 00000100:00100000:1.0:1789403336.437560:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769024 00000100:00100000:1.0:1789403336.437571:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768384 00000100:00100000:1.0:1789403336.437574:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768384 00000100:00100000:1.0:1789403336.437585:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768896 00000100:00100000:1.0:1789403336.437588:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768896 00000100:00100000:1.0:1789403336.437602:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789403336.437608:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437639:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050768512:12345-0@lo:400:kworker.0 Request processed in 31us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437646:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789403336.437658:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789403336.437665:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050769024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437706:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050769024:12345-0@lo:400:kworker.0 Request processed in 42us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437712:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789403336.437725:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789403336.437731:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050768384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437759:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050768384:12345-0@lo:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437765:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789403336.437777:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789403336.437790:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050768896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437820:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050768896:12345-0@lo:400:kworker.0 Request processed in 31us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437826:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789403336.437849:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767616 00000100:00100000:1.0:1789403336.437853:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767616 00000100:00100000:1.0:1789403336.437872:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768128 00000100:00100000:1.0:1789403336.437876:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768128 00000100:00100000:1.0:1789403336.437888:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768640 00000100:00100000:1.0:1789403336.437891:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768640 00000100:00100000:1.0:1789403336.437904:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768256 00000100:00100000:1.0:1789403336.437907:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768256 00000100:00100000:1.0:1789403336.437918:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050768768 00000100:00100000:1.0:1789403336.437920:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050768768 00000100:00100000:1.0:1789403336.437929:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050767872 00000100:00100000:1.0:1789403336.437931:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050767872 00000100:00100000:1.0:1789403336.437943:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789403336.437948:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050767616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.437979:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050767616:12345-0@lo:400:kworker.0 Request processed in 30us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.437984:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789403336.437995:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789403336.438001:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050768128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438025:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050768128:12345-0@lo:400:kworker.0 Request processed in 25us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.438030:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789403336.438041:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789403336.438046:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050768640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438082:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050768640:12345-0@lo:400:kworker.0 Request processed in 36us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.438088:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789403336.438098:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789403336.438103:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050768256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438127:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050768256:12345-0@lo:400:kworker.0 Request processed in 24us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.438132:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789403336.438143:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789403336.438149:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438174:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050768768:12345-0@lo:400:kworker.0 Request processed in 26us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.438179:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789403336.438190:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789403336.438195:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050767872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438220:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050767872:12345-0@lo:400:kworker.0 Request processed in 25us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403336.438225:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1789403336.438270:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403336.438274:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403336.438276:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789403336.438278:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403336.438304:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050767872:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438313:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050768384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438320:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050768896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438337:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050767744:0@lo:400:kworker.0 00010000:00080000:1.0:1789403336.438348:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443ff480 x1876325050768256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403336.438356:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050768256:0@lo:400:kworker.0 00010000:00080000:1.0:1789403336.438363:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144048000 x1876325050768768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403336.438370:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050768768:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438426:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050767616:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438436:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050768128:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438444:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438451:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050767488:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438459:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050768000:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438467:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403336.438475:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050769024:0@lo:400:kworker.0 00000100:00100000:0.0:1789403336.439095:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050769152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403336.439130:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403336.439166:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769152 00000100:00100000:0.0:1789403336.439172:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769152 00000100:00100000:0.0:1789403336.439202:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789403336.439208:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050769152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403336.439231:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403336.439266:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050769152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403336.439272:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789403336.439309:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050769152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403336.441262:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403336.448969:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050769280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403336.449041:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403336.449440:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769280 00000100:00100000:3.0:1789403336.449448:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769280 00000100:00100000:3.0:1789403336.449494:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789403336.449504:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050769280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403336.449528:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789403336.449587:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050769280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403336.449594:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789403336.449827:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050769280:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789403336.745194:0:15040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:28:54 (1789403334) 00000001:00080000:0.0:1789403336.953383:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789403336.953425:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789403336.953478:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789403336.953488:0:6531:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789403337.205556:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403338.225544:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403339.046130:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403339.048181:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143104 00000100:00100000:3.0:1789403339.048196:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143104 00000100:00100000:3.0:1789403339.048282:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 256 00000100:00100000:3.0:1789403339.048296:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:13172:x1876325038143104:12345-192.168.203.43@tcp:101:lsof.0 00010000:00010000:3.0:1789403339.048316:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403339.048337:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ada expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.048450:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.048463:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.048477:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403339.048524:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403339.048528:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403339.048565:0:6500:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.048589:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947e00/0x5fb08b1e5b761c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ada expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.048631:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ada expref: 6 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.048640:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:3.0:1789403339.048644:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403339.048647:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946600, rc 0) 00000100:00100000:3.0:1789403339.048719:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:13172:x1876325038143104:12345-192.168.203.43@tcp:101:lsof.0 Request processed in 428us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403339.048726:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 256 00000100:00080000:1.0:1789403339.049009:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789403339.186059:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789403339.250377:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403339.337796:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.337839:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.338037:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.338110:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403339.338183:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143232 00000100:00100000:3.0:1789403339.338194:0:6493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143232 00000100:00100000:3.0:1789403339.338248:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 394 00000100:00100000:3.0:1789403339.338259:0:6493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038143232:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403339.338327:0:6493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:166878b2-2dd8-4b83-a3c7-759691277065+13:2388:x1876325038143232:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403339.338335:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 394 00000100:00100000:0.0:1789403339.339729:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143744 00000100:00100000:0.0:1789403339.339739:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143744 00000100:00100000:0.0:1789403339.339802:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:0.0:1789403339.339810:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038143744:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:3.0:1789403339.340096:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403339.340297:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038143744:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 487us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403339.340305:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:1.0:1789403339.341472:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403339.350515:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143488 00000100:00100000:2.0:1789403339.350532:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143488 00000100:00100000:2.0:1789403339.350640:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038144000 00000100:00100000:2.0:1789403339.350645:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038144000 00000100:00100000:2.0:1789403339.350695:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 352 00000100:00100000:2.0:1789403339.350705:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038143488:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:3.0:1789403339.350759:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403339.351059:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2388:x1876325038143488:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 354us (13218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403339.351067:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 352 00000100:00100000:2.0:1789403339.351088:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 353 00000100:00100000:2.0:1789403339.351096:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038144000:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403339.351126:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2388:x1876325038144000:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (13015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403339.351132:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 353 00000100:00100000:2.0:1789403339.353610:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143360 00000100:00100000:2.0:1789403339.353622:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143360 00000100:00100000:1.0:1789403339.353636:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.353671:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143616 00000100:00100000:1.0:1789403339.353677:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143616 00000100:00100000:2.0:1789403339.353697:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 354 00000100:00100000:2.0:1789403339.353709:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2388:x1876325038143360:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403339.353717:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:1.0:1789403339.353729:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2388:x1876325038143616:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403339.353790:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:2388:x1876325038143360:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 84us (12321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403339.353792:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2388:x1876325038143616:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403339.353806:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 354 00000100:00100000:1.0:1789403339.353807:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:1.0:1789403339.353861:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00080000:3.0:1789403339.353898:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403339.353903:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403339.354313:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038143872 00000100:00100000:2.0:1789403339.354318:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038143872 00000100:00100000:2.0:1789403339.354355:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 355 00000100:00100000:2.0:1789403339.354362:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2388:x1876325038143872:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403339.354417:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2388:x1876325038143872:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 55us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403339.354423:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 355 00000100:00100000:1.0:1789403339.505618:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050769408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403339.505701:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403339.506186:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769408 00000100:00100000:0.0:1789403339.506195:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769408 00000100:00100000:0.0:1789403339.506261:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789403339.506270:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050769408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403339.506297:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1789403339.506372:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403339.506414:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050769536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403339.506448:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403339.506767:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769536 00000100:00100000:2.0:1789403339.506772:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769536 00000100:00100000:2.0:1789403339.506876:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789403339.506883:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050769536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403339.506895:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789403339.506929:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050769536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403339.506936:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789403339.506978:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050769536:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789403339.507095:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403339.507527:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050769408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1257us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403339.507534:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789403339.509636:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050769408:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789403339.762716:0:13777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789403339.762724:0:13777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403339.763229:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789403339.763239:0:13777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789403339.931185:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403339.931267:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038144256 00000100:00100000:3.0:1789403339.931277:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038144256 00000100:00100000:3.0:1789403339.931459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1789403339.931490:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+18:13173:x1876325038144256:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:3.0:1789403339.931840:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:13173:x1876325038144256:12345-192.168.203.43@tcp:35:umount.0 Request processed in 359us (663us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789403339.931848:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:3.0:1789403339.934340:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.934514:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038144512 00000100:00100000:1.0:1789403339.934523:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038144512 00000100:00100000:1.0:1789403339.934613:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:1.0:1789403339.934623:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+19:13173:x1876325038144512:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:1.0:1789403339.935001:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:13173:x1876325038144512:12345-192.168.203.43@tcp:35:umount.0 Request processed in 379us (669us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789403339.935009:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:0.0:1789403339.939820:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403339.940199:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038144768 00000100:00100000:3.0:1789403339.940209:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038144768 00000100:00100000:3.0:1789403339.940269:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:3.0:1789403339.940280:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a245cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+20:13173:x1876325038144768:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:3.0:1789403339.940821:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a245cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:13173:x1876325038144768:12345-192.168.203.43@tcp:35:umount.0 Request processed in 542us (1009us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789403339.940830:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:0.0:1789403339.943895:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.943950:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038145024 00000100:00100000:1.0:1789403339.943960:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038145024 00000100:00100000:1.0:1789403339.944049:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1789403339.944059:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:13173:x1876325038145024:12345-192.168.203.43@tcp:35:umount.0 00000100:00100000:1.0:1789403339.944296:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:13173:x1876325038145024:12345-192.168.203.43@tcp:35:umount.0 Request processed in 239us (409us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789403339.944317:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:1.0:1789403339.947554:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.947635:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.948243:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403339.948932:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038145152 00000100:00100000:3.0:1789403339.948942:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038145152 00000100:00100000:3.0:1789403339.948998:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038145408 00000100:00100000:3.0:1789403339.949001:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038145408 00000100:00100000:3.0:1789403339.949021:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1789403339.949030:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+14:2389:x1876325038145152:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403339.949044:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403339.949061:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185e00/0x5fb08b1e5b760bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128634 expref: 14 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.949077:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403339.949122:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+13:2389:x1876325038145152:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 93us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403339.949130:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1789403339.949169:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1789403339.949176:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+12:2387:x1876325038145408:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403339.949184:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403339.949192:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b760e89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12870d expref: 12 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403339.949201:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403339.949218:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:166878b2-2dd8-4b83-a3c7-759691277065+11:2387:x1876325038145408:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 43us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403339.949224:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1789403339.949673:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038145280 00000100:00100000:0.0:1789403339.949678:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038145280 00000100:00100000:0.0:1789403339.949718:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:0.0:1789403339.949729:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+11:2389:x1876325038145280:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789403339.949738:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403339.949748:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947400/0x5fb08b1e5b760b79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1285f5 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403339.949759:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403339.949788:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038145280:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 61us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403339.949796:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1789403339.949842:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403339.949868:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038145536 00000100:00100000:0.0:1789403339.949872:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038145536 00000100:00100000:0.0:1789403339.949900:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:0.0:1789403339.949907:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2386:x1876325038145536:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:0.0:1789403339.949929:0:8415:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760f54 00000100:00080000:0.0:1789403339.949937:0:8415:0:(import.c:65:import_set_state_nolock()) ffff90a1436b2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789403339.949986:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:1.0:1789403339.950072:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403339.950835:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+2:2386:x1876325038145536:12345-192.168.203.43@tcp:9:umount.0 Request processed in 926us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403339.950844:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 81 00000100:00100000:0.0:1789403339.957477:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403339.957552:0:8563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038145920 00000100:00100000:1.0:1789403339.957562:0:8563:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038145920 00000100:00100000:1.0:1789403339.957626:0:8563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:1.0:1789403339.957637:0:8563:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+7:2386:x1876325038145920:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:1.0:1789403339.957677:0:8563:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7611ca 00000020:00010000:1.0:1789403339.957684:0:8563:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a2488fc800: total 0 00000100:00080000:1.0:1789403339.957689:0:8563:0:(import.c:65:import_set_state_nolock()) ffff90a256651800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403339.957742:0:8563:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789403339.957900:0:8563:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2386:x1876325038145920:12345-192.168.203.43@tcp:9:umount.0 Request processed in 265us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403339.957908:0:8563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00000020:00010000:0.0:1789403339.958632:0:8431:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a2488fc800: total 0 00010000:00010000:0.0:1789403339.958682:0:8431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a2488fc800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789403339.958735:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b761c43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ad3 expref: 4 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403339.958765:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b761582 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288f7 expref: 3 pid: 8563 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403339.958780:0:8431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a2488fc800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789403339.958791:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403339.958794:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403339.958795:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403339.965612:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403339.965771:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038146944 00000100:00100000:0.0:1789403339.965795:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038146944 00000100:00100000:0.0:1789403339.965857:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 257 00000100:00100000:0.0:1789403339.965867:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+22:2386:x1876325038146944:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:0.0:1789403339.965899:0:6501:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b87 00000020:00010000:0.0:1789403339.965914:0:6501:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a1427a0000: total 0 00000100:00080000:0.0:1789403339.965919:0:6501:0:(import.c:65:import_set_state_nolock()) ffff90a1427a5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789403339.965946:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1789403339.966042:0:6489:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a1427a0000: total 0 00010000:00010000:1.0:1789403339.966095:0:6489:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a1427a0000, canceled 0 locks, left on hash table 13. 00000100:00100000:0.0:1789403339.966105:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+21:2386:x1876325038146944:12345-192.168.203.43@tcp:39:umount.0 Request processed in 238us (512us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789403339.966113:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 257 00010000:00010000:1.0:1789403339.966127:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403339.966132:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789403339.966141:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063600/0x5fb08b1e5b7615f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128913 expref: 20 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966163:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:1.0:1789403339.966167:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403339.966178:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7000/0x5fb08b1e5b761543 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288e2 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966193:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:1.0:1789403339.966195:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789403339.966201:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7c00/0x5fb08b1e5b76156d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288f0 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966213:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a142628b00) 00010000:00010000:1.0:1789403339.966215:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403339.966218:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b7618e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1289ec expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966237:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403339.966240:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789403339.966244:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184e00/0x5fb08b1e5b761225 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128810 expref: 16 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966258:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403339.966260:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403339.966264:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05000/0x5fb08b1e5b761c04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128abe expref: 15 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966275:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a9a00) 00010000:00010000:1.0:1789403339.966278:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403339.966282:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185200/0x5fb08b1e5b760ecf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128722 expref: 14 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966297:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403339.966303:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789403339.966308:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b761c2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128acc expref: 13 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966324:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a1434a9300) 00010000:00010000:1.0:1789403339.966327:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403339.966331:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185600/0x5fb08b1e5b761463 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb1288aa expref: 12 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966346:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:1.0:1789403339.966349:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403339.966353:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062800/0x5fb08b1e5b7615dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12890c expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966364:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a243d8b400) 00010000:00010000:1.0:1789403339.966366:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403339.966369:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b760eb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12871b expref: 10 pid: 9061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966383:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a141a01400) 00010000:00010000:1.0:1789403339.966385:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403339.966429:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b761b24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128a86 expref: 9 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966446:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a141a01e00) 00010000:00010000:1.0:1789403339.966448:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789403339.966452:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062e00/0x5fb08b1e5b760f2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128737 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403339.966476:0:6489:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a1427a0000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789403339.966489:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403339.966491:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403339.966493:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403339.981697:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403339.983998:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038147072 00000100:00100000:2.0:1789403339.984011:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038147072 00000100:00100000:2.0:1789403339.984078:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 258 00000100:00100000:2.0:1789403339.984088:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+5:2386:x1876325038147072:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:2.0:1789403339.984136:0:6500:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b8e 00000100:00080000:2.0:1789403339.984152:0:6500:0:(import.c:65:import_set_state_nolock()) ffff90a1427a2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789403339.984183:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1789403339.984376:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403339.986135:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4+3:2386:x1876325038147072:12345-192.168.203.43@tcp:39:umount.0 Request processed in 2039us (4438us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789403339.986147:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 258 00000100:00100000:1.0:1789403340.018360:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050769664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403340.018464:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403340.018544:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769664 00000100:00100000:1.0:1789403340.018552:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769664 00000100:00100000:1.0:1789403340.018610:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789403340.018619:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050769664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403340.018664:0:13789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789403340.018723:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050769664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403340.018730:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789403340.018794:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050769664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789403340.273582:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403341.041799:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403341.041823:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050769792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403341.041894:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403341.042498:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769792 00000100:00100000:2.0:1789403341.042509:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769792 00000100:00100000:2.0:1789403341.042569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789403341.042579:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050769792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403341.042631:0:6504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789403341.042699:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050769792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403341.042706:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789403341.043629:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050769792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403341.308745:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403341.553754:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050770048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403341.553829:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.554316:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050770176:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.554352:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.554378:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050770688:0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.554422:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050770304:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.554449:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403341.554481:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.554483:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050771200:0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.554510:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050770816:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.554516:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403341.554545:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.554550:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789403341.554560:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050770560:0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.554571:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050771328:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.554589:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403341.554604:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.554614:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050771072:0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.554642:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789403341.554652:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050769920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403341.554659:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403341.554687:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.554696:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770176 00000100:00100000:1.0:1789403341.554705:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770176 00000100:00100000:3.0:1789403341.554712:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050770432:0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.554738:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403341.554753:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050770944:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.554757:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789403341.554769:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050770176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.554780:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403341.554813:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770048 00000100:00100000:3.0:1789403341.554824:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770048 00000100:00100000:1.0:1789403341.554826:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3627:x1876325050770176:12345-0@lo:400:kworker.0 Request processed in 58us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.554836:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789403341.554867:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050769920 00000100:00100000:3.0:1789403341.554872:0:8418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050769920 00000100:00100000:1.0:1789403341.554876:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770560 00000100:00100000:1.0:1789403341.554882:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770560 00000100:00100000:3.0:1789403341.554897:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789403341.554905:0:8418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050770048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403341.554917:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00002000:00000024:3.0:1789403341.554929:0:8418:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789403341.554929:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050770560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403341.555031:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789403341.555040:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050769920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403341.555052:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789403341.555124:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770688 00000100:00100000:0.0:1789403341.555129:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770688 00000100:00100000:0.0:1789403341.555152:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770304 00000100:00100000:0.0:1789403341.555155:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770304 00000100:00100000:0.0:1789403341.555166:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771200 00000100:00100000:0.0:1789403341.555168:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771200 00000100:00100000:0.0:1789403341.555180:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770816 00000100:00100000:0.0:1789403341.555183:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770816 00000100:00100000:0.0:1789403341.555194:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771328 00000100:00100000:0.0:1789403341.555196:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771328 00000100:00100000:0.0:1789403341.555208:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770432 00000100:00100000:0.0:1789403341.555210:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770432 00000100:00100000:0.0:1789403341.555223:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789403341.555229:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050770688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555274:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050770560:12345-0@lo:400:kworker.0 Request processed in 349us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555281:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789403341.555303:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771072 00000100:00100000:1.0:1789403341.555307:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771072 00000100:00100000:1.0:1789403341.555330:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050770944 00000100:00100000:1.0:1789403341.555333:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050770944 00000100:00100000:1.0:1789403341.555356:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789403341.555370:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050771072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555425:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050771072:12345-0@lo:400:kworker.0 Request processed in 56us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555432:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789403341.555445:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789403341.555452:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050770944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555480:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050770944:12345-0@lo:400:kworker.0 Request processed in 29us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555486:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789403341.555506:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789403341.555513:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050770304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555543:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050770304:12345-0@lo:400:kworker.0 Request processed in 32us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555550:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789403341.555565:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789403341.555572:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050771200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555598:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876325050771200:12345-0@lo:400:kworker.0 Request processed in 27us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555604:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789403341.555615:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789403341.555620:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050770816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555659:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050770816:12345-0@lo:400:kworker.0 Request processed in 38us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555665:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789403341.555677:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789403341.555691:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050771328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555721:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050771328:12345-0@lo:400:kworker.0 Request processed in 32us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555727:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789403341.555739:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789403341.555745:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050770432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555770:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050770432:12345-0@lo:400:kworker.0 Request processed in 25us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.555775:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789403341.555824:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050770048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403341.555862:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050770560:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555873:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050771072:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555881:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050770176:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.555890:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050771200:0@lo:400:kworker.0 00000100:00080000:1.0:1789403341.555934:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789403341.555938:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403341.555940:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403341.555942:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403341.555977:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050771456:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.556005:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403341.556035:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771456 00000100:00100000:1.0:1789403341.556040:0:8416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771456 00000100:00100000:1.0:1789403341.556062:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789403341.556068:0:8416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050771456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.556112:0:8416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050771456:12345-0@lo:400:kworker.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403341.556119:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789403341.556146:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050771456:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.556185:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050770432:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.556195:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050770944:0@lo:400:kworker.0 00000100:00100000:1.0:1789403341.556205:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050770304:0@lo:400:kworker.0 00010000:00080000:1.0:1789403341.556216:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14418c700 x1876325050770816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403341.556226:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050770816:0@lo:400:kworker.0 00010000:00080000:1.0:1789403341.556235:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14418e680 x1876325050771328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403341.556243:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050771328:0@lo:400:kworker.0 00000100:00100000:3.0:1789403341.556465:0:8418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050770048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1559us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403341.556474:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789403341.556614:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050769920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1575us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403341.556622:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789403341.556720:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050769920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403341.556829:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050770688:12345-0@lo:400:kworker.0 Request processed in 1599us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403341.556848:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789403341.556903:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050770688:0@lo:400:kworker.0 00000100:00100000:0.0:1789403342.224028:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403342.224072:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403342.224106:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403342.224383:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038147200 00000100:00100000:3.0:1789403342.224417:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038147200 00000100:00100000:3.0:1789403342.224480:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038147456 00000100:00100000:3.0:1789403342.224483:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038147456 00000100:00100000:3.0:1789403342.224498:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038147328 00000100:00100000:3.0:1789403342.224500:0:6487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038147328 00000100:00100000:3.0:1789403342.224514:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403342.224521:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+12:2389:x1876325038147200:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403342.224537:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403342.224554:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b760c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128649 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403342.224572:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403342.224621:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+11:2389:x1876325038147200:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 100us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403342.224638:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403342.224655:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1789403342.224662:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+10:2389:x1876325038147456:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403342.224670:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403342.224692:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b760e82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128706 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403342.224701:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403342.224717:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+9:2389:x1876325038147456:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 58us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403342.224723:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1789403342.224734:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403342.224739:0:6487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2526d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+8:2389:x1876325038147328:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403342.224745:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403342.224753:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b760c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12867a expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403342.224761:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403342.224772:0:6487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2526d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:166878b2-2dd8-4b83-a3c7-759691277065+7:2389:x1876325038147328:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 34us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403342.224777:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403342.228047:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403342.228165:0:9061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038147712 00000100:00100000:1.0:1789403342.228173:0:9061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038147712 00000100:00100000:1.0:1789403342.228254:0:9061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 259 00000100:00100000:1.0:1789403342.228270:0:9061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+6:2386:x1876325038147712:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:1.0:1789403342.228310:0:9061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760c9f 00000020:00010000:1.0:1789403342.228317:0:9061:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a277bde800: total 0 00000100:00080000:1.0:1789403342.228321:0:9061:0:(import.c:65:import_set_state_nolock()) ffff90a277bdd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403342.228456:0:9061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1789403342.228779:0:6489:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a277bde800: total 0 00010000:00010000:0.0:1789403342.228839:0:6489:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a277bde800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789403342.228876:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142628a00) 00010000:00010000:0.0:1789403342.228880:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403342.228890:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b761c51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ada expref: 7 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403342.228986:0:6489:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a277bde800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789403342.229001:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403342.229003:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403342.229006:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403342.229089:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403342.229261:0:9061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e558fa5f-d909-4a9e-a611-b5e26918f0ce+3:2386:x1876325038147712:12345-192.168.203.43@tcp:39:umount.0 Request processed in 997us (1219us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789403342.229270:0:9061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 259 00000100:00100000:0.0:1789403342.249434:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403342.249655:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038147840 00000100:00100000:1.0:1789403342.249666:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038147840 00000100:00100000:1.0:1789403342.249786:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 260 00000100:00100000:1.0:1789403342.249798:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+5:2386:x1876325038147840:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:1.0:1789403342.249838:0:6501:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760ca6 00000100:00080000:1.0:1789403342.249848:0:6501:0:(import.c:65:import_set_state_nolock()) ffff90a277bdb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403342.249878:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789403342.250051:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e558fa5f-d909-4a9e-a611-b5e26918f0ce+3:2386:x1876325038147840:12345-192.168.203.43@tcp:39:umount.0 Request processed in 254us (670us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789403342.250060:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 260 00010000:00010000:0.0:1789403342.250162:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403342.252845:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403342.302808:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403342.302888:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148096 00000100:00100000:3.0:1789403342.302898:0:6492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148096 00000100:00100000:3.0:1789403342.302963:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 396 00000100:00100000:3.0:1789403342.302975:0:6492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+7:2386:x1876325038148096:12345-192.168.203.43@tcp:251:umount.0 00000020:00000080:3.0:1789403342.303020:0:6492:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b64 00000020:00010000:3.0:1789403342.303028:0:6492:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a1435c3000: total 0 00000100:00080000:3.0:1789403342.303032:0:6492:0:(import.c:65:import_set_state_nolock()) ffff90a1435c4000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789403342.303176:0:6492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:166878b2-2dd8-4b83-a3c7-759691277065+3:2386:x1876325038148096:12345-192.168.203.43@tcp:251:umount.0 Request processed in 202us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403342.303201:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 396 00000020:00010000:0.0:1789403342.303342:0:8432:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a1435c3000: total 0 00010000:00010000:0.0:1789403342.303347:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403342.303427:0:8432:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a1435c3000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789403342.303472:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b760bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb12863b expref: 2 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403342.303488:0:8432:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a1435c3000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789403342.303499:0:8432:0:(genops.c:885:class_export_put()) final put ffff90a1435c3000/166878b2-2dd8-4b83-a3c7-759691277065 00010000:00010000:0.0:1789403342.303517:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403342.303519:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403342.303528:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789403342.303966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1435c3000/166878b2-2dd8-4b83-a3c7-759691277065 for MGS 00000020:00000080:3.0:1789403342.304008:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1435c4000 for MGS 00010000:00010000:0.0:1789403342.321887:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403343.346641:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789403344.331754:0:15236:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789403344.342565:0:15236:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789403344.342632:0:15236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403344.342649:0:15236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403344.342671:0:15236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403344.342679:0:15236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403344.342754:0:15236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789403344.342760:0:15236:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789403344.342784:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403344.342789:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789403344.342796:0:15236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789403344.342818:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a28187e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789403344.342855:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050771584:0@lo:39:umount.0 00000100:00100000:0.0:1789403344.342920:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403344.345806:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771584 00000100:00100000:2.0:1789403344.345821:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771584 00000100:00100000:2.0:1789403344.345897:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789403344.345907:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876325050771584:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789403344.345936:0:13788:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76077b 00000100:00080000:2.0:1789403344.345945:0:13788:0:(import.c:65:import_set_state_nolock()) ffff90a2702b0800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789403344.347423:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403344.347434:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403344.347445:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403344.347458:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403344.347470:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403344.347477:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403344.347483:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403344.347485:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789403344.347489:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789403344.349088:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403344.349099:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403344.349133:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403344.349141:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946e00/0x5fb08b1e5b760c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c21 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.349311:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050771712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403344.349579:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403344.349651:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771712 00000100:00100000:1.0:1789403344.349658:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771712 00000100:00100000:1.0:1789403344.349702:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789403344.349709:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ffb2a5d6-5856-4505-b5af-5b30dcef2165+24:3626:x1876325050771712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403344.349721:0:10319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403344.349735:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b760c21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760c1a expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403344.349814:0:10319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403344.349849:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3626:x1876325050771712:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403344.349867:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789403344.349908:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050771712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403344.351260:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403344.351267:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403344.351270:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403344.352014:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3625:x1876325050771584:12345-0@lo:39:umount.0 Request processed in 6104us (9089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403344.352025:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789403344.352036:0:13788:0:(genops.c:885:class_export_put()) final put ffff90a2702b7000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789403344.352224:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403344.352257:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a28187e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789403344.352277:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050771584:0@lo:39:umount.0 00000020:00000080:3.0:1789403344.353936:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2702b7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789403344.354000:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a2702b0800 for lustre-MDT0000 00000100:00080000:2.0:1789403344.354846:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403344.354852:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789403344.354858:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789403344.357324:0:15236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357343:0:15236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357351:0:15236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357358:0:15236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357378:0:15236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403344.357408:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403344.357414:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357420:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403344.357424:0:8431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357452:0:8431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403344.357459:0:8431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403344.357465:0:8431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403344.357467:0:8431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789403344.357501:0:8431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357508:0:8431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403344.357549:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357557:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b760c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c2f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357570:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.357571:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.357573:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.357582:0:15236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357590:0:15236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357595:0:15236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.357604:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050771840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403344.357622:0:15236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.357680:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403344.357866:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771840 00000100:00100000:1.0:1789403344.357873:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771840 00000100:00100000:1.0:1789403344.357920:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403344.357929:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+23:3627:x1876325050771840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403344.357942:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403344.357954:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184200/0x5fb08b1e5b760c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760c28 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357955:0:15236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403344.357965:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403344.357966:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403344.357969:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357975:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403344.357978:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.357985:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403344.357992:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.357997:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3627:x1876325050771840:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (317us total) trans 0 rc 0/0 10000000:01000000:0.0:1789403344.357997:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403344.358000:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789403344.358002:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:1.0:1789403344.358004:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789403344.358017:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358023:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403344.358037:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.358038:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050771840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403344.358043:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b760b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760b25 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.358057:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050771968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403344.358059:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.358060:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.358062:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.358072:0:15236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.358078:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403344.358080:0:15236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358087:0:15236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358094:0:15236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358105:0:15236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789403344.358106:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050771968 00000100:00100000:1.0:1789403344.358110:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050771968 00010000:00010000:0.0:1789403344.358111:0:15236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358118:0:15236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358124:0:15236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.358130:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789403344.358131:0:15236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403344.358136:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3628:x1876325050771968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403344.358142:0:15236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789403344.358143:0:7451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1789403344.358150:0:15236:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1789403344.358151:0:7451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946200/0x5fb08b1e5b760b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760b1e expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403344.358154:0:15236:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1789403344.358163:0:7451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403344.358181:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403344.358186:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358192:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403344.358196:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358202:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403344.358209:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403344.358214:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789403344.358216:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789403344.358218:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789403344.358232:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358238:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403344.358249:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358255:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144063e00/0x5fb08b1e5b760e74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760e7b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358263:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403344.358266:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358281:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a260a26000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403344.358284:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358289:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403344.358294:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403344.358298:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403344.358300:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789403344.358302:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789403344.358314:0:8432:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358319:0:8432:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403344.358328:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358334:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a260a26000/0x5fb08b1e5b7606da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b7606e1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403344.358343:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.358345:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403344.358346:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789403344.358359:0:15236:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789403344.358362:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789403344.358366:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403344.358371:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1789403344.358380:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a14278b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403344.358386:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a142169000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403344.358407:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a2473fc000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403344.358411:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a27c33f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1789403344.358417:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff90a277bde800 e558fa5f-d909-4a9e-a611-b5e26918f0ce 192.168.203.43@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403344.358422:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff90a1427a0000 fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 192.168.203.43@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1789403344.358427:0:15236:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff90a26065cd40) has exports, disconnecting them 00000020:00080000:0.0:1789403344.358432:0:15236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a14278b800), last request at 1789403341 00000020:00000080:0.0:1789403344.358439:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a8b 00000100:00080000:0.0:1789403344.358452:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a281820800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789403344.358487:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789403344.358498:0:15236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a14278b800): rc 0 00000020:00000080:0.0:1789403344.358500:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a14278b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789403344.358509:0:15236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a142169000), last request at 1789403341 00000020:00000080:0.0:1789403344.358513:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760965 00000100:00080000:0.0:1789403344.358518:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a142168000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789403344.358527:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789403344.358533:0:15236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a142169000): rc 0 00000020:00000080:0.0:1789403344.358535:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a142169000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789403344.358539:0:15236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a2473fc000), last request at 1789403115 00000020:00000080:0.0:1789403344.358542:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760862 00000100:00080000:0.0:1789403344.358545:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a2473fe000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789403344.358553:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789403344.358559:0:15236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a2473fc000): rc 0 00000020:00000080:0.0:1789403344.358560:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a2473fc000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789403344.358564:0:15236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a27c33f000), last request at 1789403115 00000020:00000080:0.0:1789403344.358574:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760831 00000100:00080000:0.0:1789403344.358578:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a27c338800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789403344.358588:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789403344.358595:0:15236:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1789403344.358620:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3628:x1876325050771968:12345-0@lo:103:ldlm_bl.0 Request processed in 473us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403344.358626:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403344.358648:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050772096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403344.358670:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789403344.358671:0:15236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a27c33f000): rc 0 00000004:00000080:0.0:1789403344.358678:0:15236:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb21c1993ae0 00000100:00080000:0.0:1789403344.358695:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403344.358698:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1789403344.358706:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3628:1876325050771968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403344.358717:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403344.358723:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050772224:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789403344.360058:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14278b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789403344.360305:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403344.360373:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772096 00000100:00100000:1.0:1789403344.360381:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772096 00000100:00100000:1.0:1789403344.360442:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772224 00000100:00100000:1.0:1789403344.360445:0:6485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772224 00000100:00100000:1.0:1789403344.360478:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403344.360486:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+22:3629:x1876325050772096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403344.360500:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403344.360516:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184a00/0x5fb08b1e5b760e7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760e74 expref: 22 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403344.360531:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403344.360577:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+21:3629:x1876325050772096:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403344.360583:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403344.360599:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789403344.360604:0:6485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+20:3627:x1876325050772224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403344.360639:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403344.360647:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515000/0x5fb08b1e5b7606e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b7606da expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403344.360658:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403344.360684:0:6485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffb2a5d6-5856-4505-b5af-5b30dcef2165+19:3627:x1876325050772224:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000020:00000080:3.0:1789403344.364298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a142169000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789403344.364445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2473fc000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789403344.364580:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a281820800 for lustre-MDT0000 00000020:00000080:3.0:1789403344.364586:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a142168000 for lustre-MDT0000 00000020:00000080:3.0:1789403344.364589:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a2473fe000 for lustre-MDT0000 00010000:00010000:3.0:1789403344.365149:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403344.365530:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789403344.365630:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050772096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403344.365671:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050772224:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789403344.366158:0:15236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789403344.366197:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a274db0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789403344.366839:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050772352:0@lo:39:umount.0 00000100:00100000:2.0:1789403344.366905:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403344.367012:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772352 00000100:00100000:1.0:1789403344.367019:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772352 00000100:00080000:0.0:1789403344.367164:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789403344.367180:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1789403344.367194:0:15236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789403344.367252:0:15236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789403344.367265:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789403344.367275:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789403344.367278:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1789403344.367286:0:15236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789403344.367341:0:15236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789403344.367349:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a1435c5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789403344.367376:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff90a26065cd40) has no exports 00000100:00100000:1.0:1789403344.367751:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789403344.367762:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876325050772352:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789403344.367791:0:6504:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7608cb 00000100:00080000:1.0:1789403344.367799:0:6504:0:(import.c:65:import_set_state_nolock()) ffff90a27b565800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403344.367826:0:6504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789403344.367962:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3625:x1876325050772352:12345-0@lo:39:umount.0 Request processed in 202us (1056us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789403344.367971:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00010000:3.0:1789403344.368017:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403344.372298:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050772480:0@lo:9:umount.0 00000100:00100000:2.0:1789403344.372378:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403344.372426:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050772608:0@lo:9:umount.0 00000100:00100000:2.0:1789403344.372457:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789403344.372503:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a274db0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789403344.372511:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050772352:0@lo:39:umount.0 00010000:00010000:2.0:1789403344.372565:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403344.372567:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772480 00000100:00100000:0.0:1789403344.372574:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772480 00000100:00100000:0.0:1789403344.372641:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772608 00000100:00100000:0.0:1789403344.372644:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772608 00000100:00100000:0.0:1789403344.372668:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789403344.372678:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876325050772480:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789403344.372705:0:8417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a1b 00000100:00080000:0.0:1789403344.372714:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a14216e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789403344.372780:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789403344.373076:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3625:x1876325050772480:12345-0@lo:9:umount.0 Request processed in 399us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403344.373083:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789403344.373099:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789403344.373106:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876325050772608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789403344.373117:0:8417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b5d 00000100:00080000:0.0:1789403344.373123:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a14338c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789403344.373150:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789403344.373213:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3625:x1876325050772608:12345-0@lo:9:umount.0 Request processed in 108us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403344.373220:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1789403344.373236:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789403344.373537:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403344.373542:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403344.373568:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789403344.373581:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789403344.373583:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403344.373587:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050772480:0@lo:9:umount.0 00000100:00080000:2.0:1789403344.373598:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1435c5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789403344.373606:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789403344.373607:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403344.373619:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050772608:0@lo:9:umount.0 00010000:00010000:2.0:1789403344.374801:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789403344.390756:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff90a26065cd40) has no exports 00000020:00000080:0.0:1789403344.440206:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760735 00000020:00000080:0.0:1789403344.440222:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a2473f8000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789403344.440282:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789403344.440565:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403344.440575:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789403344.440579:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff90a28180cd40) has no exports 00000020:00000080:1.0:1789403344.440928:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76072e 00000020:00000080:1.0:1789403344.440934:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a281805000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789403344.440990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2473f8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789403344.441139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281805000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789403344.441205:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403344.441213:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789403344.441232:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a281800000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789403344.441234:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281800000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789403344.441242:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1789403344.626419:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050772736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403344.626488:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403344.626550:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772736 00000100:00100000:0.0:1789403344.626559:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772736 00000100:00080000:2.0:1789403344.626590:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403344.626630:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789403344.626642:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050772736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403344.626673:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789403344.626730:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050772736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403344.626736:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789403344.626984:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050772736:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789403345.393652:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403346.161864:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050772864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403346.161938:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403346.162206:0:13789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772864 00000100:00100000:0.0:1789403346.162215:0:13789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772864 00000100:00100000:0.0:1789403346.162254:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789403346.162270:0:13789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3628:x1876325050772864:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789403346.162278:0:13789:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789403346.162325:0:13789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3628:x1876325050772864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (388us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789403346.162333:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000001:00100000:1.0:1789403346.164284:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403346.164292:0:6479:0:(genops.c:885:class_export_put()) final put ffff90a27c33f000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789403346.164317:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00080000:1.0:1789403346.164326:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789403346.164329:0:6479:0:(genops.c:885:class_export_put()) final put ffff90a277bde800/e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00100000:1.0:1789403346.164334:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000001:00080000:1.0:1789403346.164338:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789403346.164348:0:6479:0:(genops.c:885:class_export_put()) final put ffff90a1427a0000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:0.0:1789403346.164463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c33f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789403346.164516:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a277bde800/e558fa5f-d909-4a9e-a611-b5e26918f0ce for lustre-MDT0000 00000020:00000080:0.0:1789403346.164539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1427a0000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-MDT0000 00000020:00000080:0.0:1789403346.164582:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27c338800 for lustre-MDT0000 00000020:00000080:0.0:1789403346.164588:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a277bdd000 for lustre-MDT0000 00000020:00000080:0.0:1789403346.164594:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1427a5000 for lustre-MDT0000 00000001:00100000:2.0:1789403346.164654:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789403346.164659:0:8409:0:(genops.c:885:class_export_put()) final put ffff90a14216c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789403346.164673:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:2.0:1789403346.164675:0:8409:0:(genops.c:885:class_export_put()) final put ffff90a2488fc800/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:0.0:1789403346.164679:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14216c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789403346.164713:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2488fc800/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-OST0000 00000020:00000080:0.0:1789403346.164730:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14216e000 for lustre-OST0000 00000020:00000080:0.0:1789403346.164733:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a256651800 for lustre-OST0000 00000001:00100000:2.0:1789403346.164858:0:7431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789403346.165064:0:7431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1789403346.165067:0:7431:0:(genops.c:885:class_export_put()) final put ffff90a27c36d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789403346.165078:0:7431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00080000:2.0:1789403346.165082:0:7431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1789403346.165084:0:7431:0:(genops.c:885:class_export_put()) final put ffff90a277bda800/e558fa5f-d909-4a9e-a611-b5e26918f0ce 00000001:00100000:2.0:1789403346.165088:0:7431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000001:00080000:2.0:1789403346.165092:0:7431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1789403346.165094:0:7431:0:(genops.c:885:class_export_put()) final put ffff90a1427a4800/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:1.0:1789403346.165788:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c36d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789403346.165834:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a277bda800/e558fa5f-d909-4a9e-a611-b5e26918f0ce for lustre-MDT0001 00000020:00000080:1.0:1789403346.165860:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1427a4800/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-MDT0001 00000020:00000080:1.0:1789403346.166569:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27b565800 for lustre-MDT0001 00000020:00000080:1.0:1789403346.166576:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a277bdb800 for lustre-MDT0001 00000020:00000080:1.0:1789403346.166579:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1427a2000 for lustre-MDT0001 00000001:00100000:0.0:1789403346.166678:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789403346.166682:0:9495:0:(genops.c:885:class_export_put()) final put ffff90a143388000/lustre-MDT0000-mdtlov_UUID 00000100:02020000:3.0:1789403346.167615:0:3628:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000020:00000080:1.0:1789403346.167802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143388000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:0.0:1789403346.167804:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:0.0:1789403346.167809:0:9495:0:(genops.c:885:class_export_put()) final put ffff90a1436b7000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 00000020:00000080:1.0:1789403346.168340:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14338c800 for lustre-OST0001 00000020:00000080:1.0:1789403346.168348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b7000/fdacff9c-139e-4f0e-9f0a-1c25cd81f6b4 for lustre-OST0001 00000020:00000080:1.0:1789403346.168378:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1436b2000 for lustre-OST0001 00000100:00080000:3.0:1789403346.173689:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789403346.173697:0:3628:0:(import.c:65:import_set_state_nolock()) ffff90a281a0f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789403346.173701:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789403346.182746:0:3628:0:(import.c:65:import_set_state_nolock()) ffff90a281a0f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403346.182759:0:3628:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 161 00000100:00080000:3.0:1789403346.182775:0:3628:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a281a0f800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403346.182839:0:3628:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b5500 x1876325050772992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403346.183017:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050772992:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789403346.183091:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403346.183205:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050772992 00000100:00100000:1.0:1789403346.183214:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050772992 00000100:00100000:1.0:1789403346.183258:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789403346.183266:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050772992:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789403346.183282:0:6504:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789403346.187237:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d212c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050772992:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 3965us (4140us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789403346.187272:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1789403346.188053:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a281a0f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403346.188060:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789403346.188065:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050772992:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1789403346.418349:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789403346.481976:0:15236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a143194cc0 - data ffff90a141c9daf8/ffff90a277bc0800 00000020:01000000:1.0:1789403346.482107:0:15236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a28189d600 - data ffff90a26d987798/ffff90a2473af800 00000001:00000004:1.0:1789403346.491767:0:15236:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789403346.533789:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789403346.533798:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789403346.533813:0:15236:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90a14418e680 x1876325050772352/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789403354 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403346.533837:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789403346.537634:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789403346.537642:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789403346.537666:0:15236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789403346.537669:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789403346.539939:0:8559:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789403346.539946:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789403346.539959:0:8559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789403346.540551:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789403346.540558:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789403346.540574:0:15236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403346.540576:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789403346.541452:0:9978:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789403346.541457:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789403346.541467:0:9978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789403346.543148:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7606fd 00000020:00000080:1.0:1789403346.543161:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a246f4c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789403346.544415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789403346.545752:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760712 00000020:00000080:1.0:1789403346.545763:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a246f4e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403346.545776:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789403346.545781:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403346.545788:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789403346.545792:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff90a26065b380) has no exports 00000020:00000080:0.0:1789403346.545921:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f4e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789403346.547238:0:15236:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789403346.547252:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b48 00000020:00000080:1.0:1789403346.547260:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a2473f9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403346.547368:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789403346.547376:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403346.547411:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789403346.547416:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff90a1425d3380) has no exports 00000020:00000080:1.0:1789403346.547423:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b41 00000020:00000080:1.0:1789403346.547428:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a1435c2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789403346.554493:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2473f9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789403346.562663:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1435c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789403346.563812:0:15236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789403346.563819:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789403346.563823:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789403346.563830:0:15236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403346.563833:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789403346.563911:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403346.563926:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403346.563936:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a06 00000020:00000080:1.0:1789403346.563946:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a1421c5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403346.563952:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789403346.563957:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403346.563962:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789403346.563966:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff90a27dbd19c0) has no exports 00000020:00000080:1.0:1789403346.563972:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7609ff 00000020:00000080:1.0:1789403346.563975:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a27dbdf800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789403346.564277:0:15236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789403346.564280:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789403346.564282:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789403346.564286:0:15236:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403346.564288:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403346.564420:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1435c5800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789403346.564428:0:36:0:(genops.c:885:class_export_put()) final put ffff90a25d730000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789403346.564431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a25d730000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789403346.564437:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403346.564521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789403346.564527:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27dbdf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789403346.564531:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27dbdf000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789403346.565432:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403346.565446:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403346.565450:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a1421c4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789403346.565453:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789403346.565459:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789403346.565529:0:15236:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789403346.565537:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7608b6 00000020:00000080:1.0:1789403346.565542:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a27c35e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403346.565554:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789403346.565558:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403346.565562:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789403346.565565:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff90a281ae19c0) has no exports 00000020:00000080:1.0:1789403346.565570:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7608af 00000020:00000080:1.0:1789403346.565573:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a274db7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789403346.566411:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c35e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789403346.566421:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a274db7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789403346.566450:0:15236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789403346.566453:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403346.566457:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789403346.566462:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403346.566481:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a274db0800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789403346.566508:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403346.566520:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403346.566524:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a274db2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789403346.566527:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a274db2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789403346.566531:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403346.566617:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403346.566621:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403346.566624:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a247390800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789403346.566626:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a247390800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789403346.566632:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403346.566694:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760719 00000020:00000080:0.0:1789403346.566710:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a246f4d000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789403346.566719:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789403346.566727:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f4d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789403346.566738:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403346.566742:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403346.566745:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff90a260658000) has no exports 00000020:00000080:0.0:1789403346.566766:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403346.566770:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789403346.566773:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a246f49000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789403346.566775:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f49000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789403346.566779:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789403346.566813:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760720 00000020:00000080:0.0:1789403346.566818:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a246f4a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789403346.566831:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f4a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789403346.566844:0:15236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a244ea0000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789403346.566848:0:15236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a244ea0000 3 00000020:01000004:0.0:1789403346.566852:0:15236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a244ea0000 from lustre-MDT0000 00000020:00000080:0.0:1789403346.566874:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403346.566880:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789403346.566883:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a246f4b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789403346.566885:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f4b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789403346.566894:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789403346.566974:0:15236:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789403346.566979:0:15236:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789403346.566982:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789403346.566989:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403346.566993:0:15236:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789403346.567002:0:15236:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff90a26d348000 ffb2a5d6-5856-4505-b5af-5b30dcef2165 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403346.567010:0:15236:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff90a2606599c0) has exports, disconnecting them 00000020:00080000:0.0:1789403346.567013:0:15236:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90a26d348000), last request at 1789403092 00000020:00000080:0.0:1789403346.567031:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7606be 00000020:00010000:0.0:1789403346.567040:0:15236:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a26d348000: total 0 00000100:00080000:0.0:1789403346.567045:0:15236:0:(import.c:65:import_set_state_nolock()) ffff90a26d34e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789403346.567058:0:15236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a26d348000): rc 0 00000020:00080000:0.0:1789403346.567062:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff90a2606599c0) has no exports 00000020:00010000:0.0:1789403346.567072:0:8431:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a26d348000: total 0 00010000:00010000:0.0:1789403346.567096:0:8431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a26d348000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789403346.567126:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b760c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760bfe expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567143:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241514c00/0x5fb08b1e5b7607ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b7607b3 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567160:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b760bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760bf0 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567172:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c7e00/0x5fb08b1e5b760e5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760e58 expref: 11 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567182:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144062600/0x5fb08b1e5b760e6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760e66 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567192:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b760c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760c0c expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567203:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a26200/0x5fb08b1e5b7607c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b7607c1 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567215:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144062c00/0x5fb08b1e5b760e51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760e4a expref: 7 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567238:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185400/0x5fb08b1e5b760c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760c36 expref: 6 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567267:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b760bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760bc6 expref: 5 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567279:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a260a27e00/0x5fb08b1e5b760adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760ad8 expref: 4 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567294:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b760bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760bd4 expref: 3 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567316:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946a00/0x5fb08b1e5b760be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b760be2 expref: 2 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403346.567327:0:8431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a26d348000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789403346.567341:0:8431:0:(genops.c:885:class_export_put()) final put ffff90a26d348000/ffb2a5d6-5856-4505-b5af-5b30dcef2165 00010000:00010000:0.0:1789403346.567350:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403346.567352:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403346.567354:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789403346.567360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a26d348000/ffb2a5d6-5856-4505-b5af-5b30dcef2165 for MGS 00000020:00000080:0.0:1789403346.567380:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a26d34e800 for MGS 00000100:00100000:0.0:1789403346.567510:0:6493:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff90a242ed5800:6493] 1 exiting: rc = 0 00000100:00100000:0.0:1789403346.567633:0:6495:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff90a27a75ec00:6495] 2 exiting: rc = 0 00000100:00100000:3.0:1789403346.569568:0:6492:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff90a242ed4000:6492] 0 exiting: rc = 1 00000100:00100000:0.0:1789403346.571855:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571866:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571873:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571878:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571884:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571889:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571894:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571900:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571907:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571928:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571934:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571939:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571945:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571951:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571957:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571966:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.571972:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572379:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572407:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572416:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572426:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572434:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572444:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572450:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572455:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572462:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572471:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572478:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572494:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572500:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572506:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572516:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572522:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572528:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572533:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572539:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572545:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572556:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572561:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572568:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572574:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572699:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572708:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572714:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572728:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572735:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572741:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572747:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572752:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572758:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572764:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572770:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572775:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572781:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572786:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572792:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572797:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572802:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.572807:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.573077:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.573087:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.573093:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.573098:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403346.573104:0:15236:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789403346.574990:0:15236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a27c207540 - data ffff90a141c18870/ffff90a274f3b400 00000020:01000000:3.0:1789403346.575115:0:15236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a245dbbae0 - data ffff90a26d832bd0/ffff90a27a56b800 00000020:00000080:3.0:1789403346.575971:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7606a2 00000020:00000080:3.0:1789403346.575981:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a25d731800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789403346.575997:0:15236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a244ea0000 from MGS, refs=2 00000020:01000004:3.0:1789403346.576001:0:15236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a244ea0000 2 00000020:01000004:3.0:1789403346.576004:0:15236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a244ea0000 from MGS 00000020:00000080:3.0:1789403346.576026:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789403346.576033:0:15236:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789403346.576036:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a25d734800/MGS 00000020:00000080:3.0:1789403346.576039:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a25d734800/MGS for MGS 00000020:01000000:3.0:1789403346.576045:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789403346.576113:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789403346.576118:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789403346.576123:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789403346.576129:0:15236:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90a2702b7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789403346.576135:0:15236:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff90a281874d40) has exports, disconnecting them 00000020:00080000:3.0:1789403346.576139:0:15236:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90a2702b7800), last request at 1789403092 00000020:00000080:3.0:1789403346.576156:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76076d 00000020:00080000:3.0:1789403346.576166:0:15236:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a2702b7800): rc 0 00000020:00000080:3.0:1789403346.576171:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a2702b7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789403346.576933:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a25d731800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789403346.576944:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2702b7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789403346.580437:0:15236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789403346.580447:0:15236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403346.580451:0:15236:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403346.580458:0:15236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403346.580492:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a28187e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789403346.580732:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403346.580742:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789403346.580748:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a260630000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789403346.580752:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a260630000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789403346.580762:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789403346.580880:0:15236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a244ea0000 1 00000020:00000080:0.0:1789403346.580887:0:15236:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760694 00000020:00000080:0.0:1789403346.580893:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a25d737000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789403346.580901:0:15236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789403346.580908:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a25d737000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789403346.580917:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403346.580922:0:15236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403346.580926:0:15236:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff90a245c999c0) has no exports 00000100:00100000:2.0:1789403346.673551:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403346.676848:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050773248:0@lo:400:kworker.0 00000400:00000100:1.0:1789403346.676900:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876325050773248 offset 0 length 224: 4 00000100:00100000:1.0:1789403346.676964:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403346.676970:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050773376:0@lo:400:kworker.0 00000100:00100000:1.0:1789403346.677002:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403346.677036:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050773376 00000100:00100000:1.0:1789403346.677042:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050773376 00000100:00100000:1.0:1789403346.677083:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789403346.677090:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1876325050773376:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789403346.677098:0:6499:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789403346.677138:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3626:x1876325050773376:12345-0@lo:400:kworker.0 Request processed in 47us (134us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789403346.677145:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:1.0:1789403346.677183:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789403346.677188:0:3626:0:(import.c:65:import_set_state_nolock()) ffff90a27c36f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789403346.677192:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789403346.677781:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050773504:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.677817:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.677839:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050773120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403346.677864:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.677900:0:10332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050773120 00000100:00100000:2.0:1789403346.677905:0:10332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050773120 00000100:00100000:2.0:1789403346.677947:0:10332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789403346.677955:0:10332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050773120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403346.677979:0:10332:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789403346.678016:0:10332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050773120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403346.678022:0:10332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1789403346.678051:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403346.678085:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050773120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789403346.681036:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403346.681054:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050773632:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.681116:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.681173:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403346.681181:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050773760:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.681206:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.681251:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050773888:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.681270:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.681295:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050773504 00000100:00100000:2.0:1789403346.681302:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050773504 00000100:00100000:2.0:1789403346.681332:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050773632 00000100:00100000:2.0:1789403346.681334:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050773632 00000100:00100000:2.0:1789403346.681358:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050773888 00000100:00100000:2.0:1789403346.681360:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050773888 00000100:00100000:2.0:1789403346.681372:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789403346.681380:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050773632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.681445:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050773632:12345-0@lo:400:kworker.0 Request processed in 67us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403346.681452:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789403346.681468:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789403346.681472:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3628:x1876325050773504:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789403346.681477:0:13788:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789403346.681497:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3628:x1876325050773504:12345-0@lo:400:kworker.0 Request processed in 24us (3680us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789403346.681502:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789403346.681526:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789403346.681529:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3627:x1876325050773888:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789403346.681533:0:13788:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789403346.681559:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3627:x1876325050773888:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789403346.681564:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789403346.681576:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403346.681609:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789403346.681613:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789403346.681617:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789403346.681622:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403346.681625:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:2.0:1789403346.681634:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a14278f000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403346.681655:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e6a00 x1876325050774016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403346.681674:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1876325050773888:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.681694:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050774016:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789403346.681717:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.681740:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774016 00000100:00100000:2.0:1789403346.681744:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774016 00000100:00100000:2.0:1789403346.681757:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789403346.681761:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3625:x1876325050774016:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1789403346.681779:0:13788:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789403346.681808:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3625:x1876325050774016:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 46us (91us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789403346.681822:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1789403346.681846:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403346.681850:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789403346.681852:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050774016:0@lo:38:ptlrpcd_00_01.0 00010000:00080000:2.0:1789403346.681874:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e4e00 x1876325050773632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403346.681885:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050773632:0@lo:400:kworker.0 00000100:00080000:2.0:1789403346.681895:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789403346.681898:0:3628:0:(import.c:65:import_set_state_nolock()) ffff90a1421c3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789403346.681902:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789403346.681905:0:3628:0:(import.c:65:import_set_state_nolock()) ffff90a1421c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403346.681909:0:3628:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 183 00000100:00080000:2.0:1789403346.681914:0:3628:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a1421c3000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403346.681928:0:3628:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e6a00 x1876325050774144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403346.681944:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050773504:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.681964:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050774144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789403346.681987:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.682011:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774144 00000100:00100000:2.0:1789403346.682015:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774144 00000100:00100000:2.0:1789403346.682027:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789403346.682033:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3625:x1876325050774144:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789403346.682043:0:13788:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789403346.682080:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3625:x1876325050774144:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 47us (92us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789403346.682087:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789403346.682110:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1421c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403346.682114:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789403346.682117:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050774144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789403346.682151:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050774272:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.682175:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403346.682198:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774272 00000100:00100000:2.0:1789403346.682202:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774272 00000100:00100000:2.0:1789403346.682226:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789403346.682232:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050774272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.682264:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050774272:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403346.682270:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:2.0:1789403346.682284:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789403346.682299:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6a00 x1876325050774272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403346.682309:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050774272:0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.682375:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050773760 00000100:00100000:2.0:1789403346.682379:0:8417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050773760 00000100:00100000:2.0:1789403346.682431:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789403346.682438:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050773760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403346.682471:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050773760:12345-0@lo:400:kworker.0 Request processed in 34us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403346.682486:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1789403346.682501:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403346.682517:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050773760:0@lo:400:kworker.0 00000020:00000080:2.0:1789403346.687028:0:15236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403346.687041:0:15236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789403346.687046:0:15236:0:(genops.c:885:class_export_put()) final put ffff90a258ac9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789403346.687051:0:15236:0:(genops.c:844:class_export_destroy()) destroying export ffff90a258ac9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789403346.687060:0:15236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789403346.687214:0:15236:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a2599bf000 00000020:02000400:2.0:1789403346.687283:0:15236:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:1.0:1789403346.688971:0:3626:0:(import.c:65:import_set_state_nolock()) ffff90a27c36f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403346.688982:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 161 00000100:00080000:1.0:1789403346.688996:0:3626:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a27c36f000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403346.689038:0:3626:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144181880 x1876325050774400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403346.689070:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050773376:0@lo:400:kworker.0 00000100:00100000:1.0:1789403346.689089:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050774400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789403346.689151:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403346.689208:0:13788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774400 00000100:00100000:1.0:1789403346.689214:0:13788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774400 00000100:00100000:1.0:1789403346.689250:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789403346.689257:0:13788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3625:x1876325050774400:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1789403346.689292:0:13788:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789403346.689334:0:13788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3625:x1876325050774400:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 75us (182us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789403346.689340:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789403346.689381:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27c36f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403346.689432:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789403346.689437:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050774400:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1789403347.441548:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403348.466097:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403349.426034:0:13780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789403349.489682:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403349.746102:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403349.746117:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050774528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403349.746187:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403349.746266:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774528 00000100:00100000:1.0:1789403349.746274:0:8419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774528 00000100:00100000:1.0:1789403349.746339:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789403349.746349:0:8419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050774528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403349.746377:0:8419:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789403349.746447:0:8419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050774528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00080000:2.0:1789403349.746453:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403349.746457:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789403349.746511:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050774528:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789403350.515561:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789403350.653071:0:15438:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789403350.667546:0:15438:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789403350.667608:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.667633:0:15438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.667640:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.667648:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.667668:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789403350.667672:0:15438:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789403350.667709:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1789403350.667710:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403350.667716:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789403350.667720:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789403350.667723:0:15438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789403350.667731:0:15438:0:(import.c:65:import_set_state_nolock()) ffff90a27c36f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789403350.667732:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05600 already unused, calling callback (ffffffffc120dc20) 00000100:00080000:3.0:1789403350.667738:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1789403350.667738:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403350.667748:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403350.667755:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403350.667760:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789403350.667763:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789403350.667766:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789403350.667911:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403350.667919:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403350.667953:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403350.667961:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b05600/0x5fb08b1e5b760bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c05 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403350.667975:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403350.667977:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403350.667990:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403350.668126:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403350.668147:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050774656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403350.668171:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789403350.668176:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789403350.668214:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403350.668341:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774656 00000100:00100000:2.0:1789403350.668349:0:10319:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774656 00000100:00100000:2.0:1789403350.668417:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403350.668424:0:10319:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3627:x1876325050774656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789403350.668431:0:10319:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789403350 with bad export cookie 6895163992003970750 00010000:00010000:3.0:1789403350.669936:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670022:0:15438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670030:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670038:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670100:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403350.670108:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670115:0:15438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670122:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.670130:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670232:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403350.670239:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670247:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403350.670250:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670259:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403350.670267:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403350.670273:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403350.670276:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789403350.670301:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670317:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403350.670344:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670351:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b760c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760c13 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670375:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403350.670379:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670404:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403350.670408:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670416:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403350.670423:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403350.670429:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403350.670431:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789403350.670442:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670448:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403350.670462:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.670479:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403350.670481:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403350.670483:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403350.670491:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403350.670505:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050774912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403350.670557:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403350.670748:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774912 00000100:00100000:1.0:1789403350.670755:0:6486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774912 00000100:00100000:1.0:1789403350.670783:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789403350.670790:0:6486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26070f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3629:x1876325050774912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789403350.670796:0:6486:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789403350 with bad export cookie 6895163992003970750 00000100:00100000:1.0:1789403350.670843:0:6486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26070f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3629:x1876325050774912:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (285us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789403350.670850:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789403350.670872:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403350.670879:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050774784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403350.670900:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403350.670938:0:7451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050774784 00000100:00100000:1.0:1789403350.670949:0:7451:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050774784 00000100:00100000:1.0:1789403350.670968:0:7451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789403350.670972:0:7451:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1876325050774784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789403350.670977:0:7451:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789403350 with bad export cookie 6895163992003970750 00000100:00100000:1.0:1789403350.671003:0:7451:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1876325050774784:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (102us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789403350.671009:0:7451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789403350.671034:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789403350.671038:0:3626:0:(import.c:65:import_set_state_nolock()) ffff90a270141800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789403350.671042:0:3626:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789403350.671925:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789403350.671935:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1a00/0x5fb08b1e5b760ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760adf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.672053:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789403350.672085:0:15438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789403350.672613:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672688:0:15438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672696:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672702:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672717:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403350.672722:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672728:0:15438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672735:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672742:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.672753:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789403350.672756:0:15438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789403350.672759:0:15438:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789403350.672789:0:15438:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789403350.672792:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789403350.672796:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789403350.672801:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789403350.672809:0:15438:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff90a14278c000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789403350.672816:0:15438:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff90a1421c1800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789403350.672821:0:15438:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff90a281808000) has exports, disconnecting them 00000020:00080000:3.0:1789403350.672824:0:15438:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a14278c000), last request at 1789403346 00000020:00000080:3.0:1789403350.672831:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760aa0 00000100:00080000:3.0:1789403350.672843:0:15438:0:(import.c:65:import_set_state_nolock()) ffff90a14278e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789403350.672876:0:15438:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a14278c000): rc 0 00000020:00000080:3.0:1789403350.672879:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a14278c000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:0.0:1789403350.672903:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403350.672909:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.672916:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403350.672920:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.672928:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403350.672935:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403350.672950:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789403350.672952:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789403350.672954:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1789403350.673026:0:15438:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a1421c1800), last request at 1789403346 00000020:00000080:3.0:1789403350.673030:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76097a 00000100:00080000:3.0:1789403350.673035:0:15438:0:(import.c:65:import_set_state_nolock()) ffff90a1421c2000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789403350.673044:0:15438:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1421c1800): rc 0 00000020:00000080:3.0:1789403350.673046:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a1421c1800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789403350.673053:0:15438:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb21c0e33ae0 00000100:00080000:3.0:1789403350.673070:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403350.673077:0:15438:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff90a141aad500 x1876325050772864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789403362 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403350.673089:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789403350.674313:0:15438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789403350.674321:0:15438:0:(import.c:65:import_set_state_nolock()) ffff90a281a0f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1789403350.674558:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403350.674572:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.674582:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403350.674586:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.674614:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403350.674727:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403350.674734:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403350.674737:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789403350.674739:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1789403350.687952:0:3626:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.143@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789403350.687957:0:3626:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789403350.687966:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1442b5500 x1876325050773248/t0(0) o400->MGC192.168.203.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789403362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403350.687980:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e6a00 x1876325050774656/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789403366 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403350.687999:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418ed80 x1876325050774912/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789403366 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403350.688010:0:3626:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418c000 x1876325050774784/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789403366 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789403350.688104:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.688115:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403350.688129:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.688137:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0e00/0x5fb08b1e5b7607c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b7607c8 expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403350.688163:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403350.688165:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403350.688167:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789403350.688214:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789403350.688217:0:3626:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789403350.688218:0:3626:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789403350.688222:0:3626:0:(import.c:65:import_set_state_nolock()) ffff90a270141800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403350.688226:0:3626:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 138 00000100:00080000:1.0:1789403350.688239:0:3626:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff90a270141800 using connection 192.168.203.143@tcp/0@lo 00010000:00010000:1.0:1789403350.688248:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403350.688265:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050772864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403350.688299:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403350.688306:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ffb2a5d6-5856-4505-b5af-5b30dcef2165:0:1876325050775040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403350.688329:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3629:1876325050774912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403350.688347:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3627:1876325050774656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403350.688374:0:3626:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144181c00 x1876325050775168/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403350.688426:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050773248:0@lo:400:kworker.0 00000100:00100000:1.0:1789403350.688438:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3626:1876325050774784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403350.688525:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3625:1876325050775168:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789403350.688576:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876325050775168 offset 0 length 520: 4 00010000:00010000:1.0:1789403350.688702:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789403350.688711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14278c000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789403350.688758:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c1800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789403350.688780:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14278e000 for lustre-MDT0001 00000020:00000080:1.0:1789403350.688784:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1421c2000 for lustre-MDT0001 00010000:00010000:0.0:1789403350.688892:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.688901:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789403350.688935:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ffb2a5d6-5856-4505-b5af-5b30dcef2165:0:1876325050775296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403350.688965:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.688978:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b760e66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b760e6d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403350.688989:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403350.688991:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403350.688993:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403350.689596:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789403350.689600:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789403350.689617:0:15438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789403350.689680:0:15438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789403350.689694:0:15438:0:(import.c:65:import_set_state_nolock()) ffff90a1421c7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789403350.689703:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789403350.689705:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789403350.689712:0:15438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789403350.689778:0:15438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789403350.689786:0:15438:0:(import.c:65:import_set_state_nolock()) ffff90a27c33b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789403350.689796:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050775424:0@lo:9:umount.0 00000020:00080000:0.0:1789403350.689808:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff90a281808000) has no exports 00000100:00100000:1.0:1789403350.689846:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403350.689880:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050775552:0@lo:9:umount.0 00000100:00100000:1.0:1789403350.689901:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403350.689936:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050775424 00000100:00100000:1.0:1789403350.689943:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050775424 00000100:00100000:1.0:1789403350.689984:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050775552 00000100:00100000:1.0:1789403350.689987:0:8415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050775552 00000100:00100000:0.0:1789403350.690015:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789403350.690026:0:8417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876325050775424:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789403350.690047:0:8417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7609c7 00000100:00080000:0.0:1789403350.690055:0:8417:0:(import.c:65:import_set_state_nolock()) ffff90a141b02800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789403350.690067:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403350.690075:0:8415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876325050775552:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789403350.690090:0:8415:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b09 00000001:00000004:0.0:1789403350.690093:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1789403350.690096:0:8415:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789403350.690131:0:8415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789403350.690249:0:8415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3625:x1876325050775552:12345-0@lo:9:umount.0 Request processed in 174us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403350.690252:0:8417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3625:x1876325050775424:12345-0@lo:9:umount.0 Request processed in 227us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403350.690261:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789403350.690270:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:0.0:1789403350.690447:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789403350.690523:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27c33b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789403350.690534:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789403350.690536:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403350.690540:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050775552:0@lo:9:umount.0 00000100:00080000:1.0:1789403350.690550:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1421c7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789403350.690559:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789403350.690571:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403350.690575:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050775424:0@lo:9:umount.0 00000100:00080000:3.0:1789403350.690669:0:6496:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789403350.690680:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1789403350.696379:0:10319:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876325050774656 offset 224 length 224: 4 00000100:00100000:2.0:1789403350.696451:0:10319:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3627:x1876325050774656:12345-0@lo:103:ldlm_bl.0 Request processed in 28023us (28235us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789403350.697242:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:2.0:1789403350.706729:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff90a281808000) has no exports 00000020:01000000:3.0:1789403350.816610:0:15438:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a143194c60 - data ffff90a141c9de58/ffff90a277bc2c00 00000020:01000000:3.0:1789403350.816770:0:15438:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a27a5ab4e0 - data ffff90a26da39288/ffff90a27c1c9000 00000001:00000004:3.0:1789403350.834227:0:15438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789403350.894870:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403350.894877:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789403350.894885:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789403350.898095:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789403350.898101:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789403350.898110:0:15438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403350.898113:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789403350.898641:0:8549:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789403350.898651:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789403350.898661:0:8549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789403350.899112:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789403350.899116:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789403350.899134:0:15438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403350.899136:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789403350.899577:0:9968:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789403350.899581:0:9968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1789403350.899589:0:9968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789403350.900519:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7607e4 00000020:00000080:2.0:1789403350.900529:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a27b562000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789403350.901918:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27b562000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789403350.902158:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7607f9 00000020:00000080:2.0:1789403350.902166:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281827000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789403350.902184:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789403350.902189:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403350.902196:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789403350.902200:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff90a2818719c0) has no exports 00000020:00000080:3.0:1789403350.902530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281827000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1789403350.902704:0:15438:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789403350.902713:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760b02 00000020:00000080:2.0:1789403350.902717:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a1421c6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789403350.902770:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789403350.902774:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403350.902781:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403350.902784:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff90a27c364d40) has no exports 00000020:00000080:2.0:1789403350.902788:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760afb 00000020:00000080:2.0:1789403350.902792:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a27c33c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789403350.905007:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1789403350.909511:0:15438:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789403350.909519:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789403350.909523:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789403350.909529:0:15438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403350.909532:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789403350.909574:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403350.909587:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789403350.909595:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7609c0 00000020:00000080:2.0:1789403350.909604:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a141b01000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789403350.909611:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789403350.909619:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403350.909638:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403350.909641:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff90a281ae0000) has no exports 00000020:00000080:2.0:1789403350.909648:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7609b9 00000020:00000080:2.0:1789403350.909652:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a1421c7800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789403350.909972:0:15438:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789403350.909975:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789403350.909977:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789403350.909981:0:15438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403350.909982:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789403350.910002:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403350.910006:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789403350.910017:0:15438:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789403350.910022:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76081c 00000020:00000080:2.0:1789403350.910027:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a27b561000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789403350.910030:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789403350.910033:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403350.910036:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403350.910038:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff90a28180b380) has no exports 00000020:00000080:2.0:1789403350.910042:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760815 00000020:00000080:2.0:1789403350.910044:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281a0c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789403350.912063:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c33c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789403350.912080:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27c33b800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789403350.912089:0:36:0:(genops.c:885:class_export_put()) final put ffff90a141a3f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789403350.912092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141a3f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789403350.912096:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403350.912184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141b01000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789403350.912190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789403350.912194:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1421c7000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789403350.912198:0:36:0:(genops.c:885:class_export_put()) final put ffff90a1421c2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789403350.912199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789403350.912204:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403350.912229:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27b561000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789403350.912234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789403350.913510:0:15438:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789403350.913516:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403350.913521:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789403350.913528:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789403350.913590:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789403350.913601:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403350.913628:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789403350.913646:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403350.913652:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281b10000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789403350.913655:0:15438:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281b10000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789403350.913661:0:15438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403350.913799:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760800 00000020:00000080:3.0:1789403350.913807:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281824800/lustre-MDD0001_UUID 00000020:01000000:3.0:1789403350.913811:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789403350.913815:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789403350.913819:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789403350.913823:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff90a2818099c0) has no exports 00000020:00000080:3.0:1789403350.913841:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789403350.913845:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789403350.913848:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760807 00000020:00000080:3.0:1789403350.913851:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281827800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789403350.913859:0:15438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a281b11800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789403350.913862:0:15438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a281b11800 2 00000020:01000004:3.0:1789403350.913865:0:15438:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a281b11800 from lustre-MDT0001 00000020:00000080:3.0:1789403350.913884:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789403350.913887:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789403350.913889:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281a08000/lustre-MDT0001_UUID 00000020:00000080:3.0:1789403350.913891:0:15438:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a08000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789403350.913901:0:15438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789403350.913928:0:15438:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789403350.913932:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789403350.913935:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789403350.913938:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789403350.913944:0:15438:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90a27c35d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789403350.913949:0:15438:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff90a27c360000) has exports, disconnecting them 00000020:00080000:3.0:1789403350.913953:0:15438:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90a27c35d000), last request at 1789403115 00000020:00000080:0.0:1789403350.914035:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a281a0f800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789403350.914042:0:36:0:(genops.c:885:class_export_put()) final put ffff90a281826000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789403350.914044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281826000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789403350.914048:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789403350.914128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281824800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789403350.914132:0:36:0:(genops.c:885:class_export_put()) final put ffff90a281a0a000/lustre-MDD0001_UUID 00000020:00000080:0.0:1789403350.914134:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789403350.914137:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789403350.914327:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281827800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789403350.914619:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76085b 00000020:00080000:3.0:1789403350.914631:0:15438:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a27c35d000): rc 0 00000020:00000080:3.0:1789403350.914641:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a27c35d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789403350.919511:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c35d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789403350.962456:0:15438:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789403350.962465:0:15438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403350.962469:0:15438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403350.962477:0:15438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403350.962508:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27c36f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789403350.962709:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403350.962719:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789403350.962724:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a27c33d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789403350.962728:0:15438:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c33d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789403350.962741:0:15438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789403350.962819:0:15438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a281b11800 1 00000020:00000080:0.0:1789403350.962824:0:15438:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760797 00000020:00000080:0.0:1789403350.962831:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281a0e000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789403350.962839:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789403350.962847:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789403350.962856:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403350.962861:0:15438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403350.962876:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff90a281870000) has no exports 00000020:00000080:2.0:1789403351.076014:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403351.076028:0:15438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789403351.076034:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a281b16800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789403351.076039:0:15438:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281b16800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789403351.076051:0:15438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789403351.076163:0:15438:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a281b15000 00000020:01000000:2.0:1789403351.076182:0:15438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789403351.076185:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403351.076189:0:15438:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789403351.076193:0:15438:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff90a245c9cd40) has no exports 00000100:00100000:3.0:1789403351.078984:0:9061:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff90a274d38c00:9061] 3 exiting: rc = 0 00000100:00100000:0.0:1789403351.080130:0:6501:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff90a27a752a00:6501] 2 exiting: rc = 0 00000100:00100000:1.0:1789403351.083068:0:13788:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff90a277b89a00:13788] 4 exiting: rc = 0 00000100:00100000:1.0:1789403351.083200:0:6500:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff90a27a752e00:6500] 1 exiting: rc = 0 00000100:00100000:2.0:1789403351.085495:0:6499:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff90a2460e7400:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1789403351.085657:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085665:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085670:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085676:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085682:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085687:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085692:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085697:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085702:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085715:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085721:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085726:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085731:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085736:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085741:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085746:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085751:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085756:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085761:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085766:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085771:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085776:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085781:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085786:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085790:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085795:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085800:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085805:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085810:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085815:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085820:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085825:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085830:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085848:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085853:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085858:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085863:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085869:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085874:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085879:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085883:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085888:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085894:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085899:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085904:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085918:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085924:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085929:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085934:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085940:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085944:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085949:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085954:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085958:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085963:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085968:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085973:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085978:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085983:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085988:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085993:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.085999:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.086003:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.086008:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403351.088166:0:6503:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90a27a771c00:6503] 1 exiting: rc = 0 00000100:00100000:2.0:1789403351.088305:0:6502:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90a27a770200:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1789403351.099062:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099073:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099080:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099085:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099106:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099112:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099119:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099125:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099131:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099137:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099143:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099149:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099158:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099163:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099167:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099173:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099177:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099182:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099187:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099192:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099198:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099203:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099208:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099213:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099219:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099224:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099230:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099234:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099239:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099258:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099263:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099277:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099283:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099288:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099293:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099298:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099303:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099307:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099312:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099325:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099330:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099335:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099340:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099345:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099351:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099357:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099362:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099367:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099373:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099378:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099383:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099415:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099422:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099427:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099432:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099437:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099442:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099453:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099458:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099463:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099468:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099473:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099479:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099484:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.099971:0:13789:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff90a274fce000:13789] 2 exiting: rc = 0 00000100:00100000:2.0:1789403351.100189:0:6505:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff90a27a59d000:6505] 1 exiting: rc = 0 00000100:00100000:1.0:1789403351.100721:0:6504:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff90a2564b6200:6504] 0 exiting: rc = 1 00000100:00100000:0.0:1789403351.101115:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101123:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101132:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101138:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101145:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101151:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101157:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101163:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101170:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101193:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101199:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101206:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101212:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101219:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101225:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101232:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101238:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101364:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101370:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101375:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101381:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101743:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101751:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101759:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101766:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101772:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101778:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101784:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101790:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101797:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101802:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101808:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101813:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101832:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101841:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101848:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101854:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101859:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101865:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101871:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101877:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101883:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101888:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101893:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101909:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.101995:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102003:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102009:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102014:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102023:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102029:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102035:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102041:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102047:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102052:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102059:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102065:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102086:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102093:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102099:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102105:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102111:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102116:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.102129:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403351.118831:0:6506:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90a270180200:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1789403351.120893:0:6507:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90a270181c00:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1789403351.121011:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121019:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121024:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121030:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121035:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121040:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121045:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121050:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121055:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121060:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121066:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121071:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121075:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121080:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121085:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121100:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121105:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121110:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121115:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121120:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121125:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121130:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121134:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121139:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121144:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121148:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121153:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121158:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121162:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121167:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121172:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121177:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121181:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121186:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121192:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121196:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121201:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121205:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121211:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121215:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121220:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121225:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121230:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121235:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121248:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121254:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121259:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121264:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121274:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121279:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121290:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121295:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121301:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121306:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121311:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121316:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121321:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121326:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121330:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121335:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121340:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121345:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121349:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.121354:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403351.122002:0:6509:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90a270181600:6509] 1 exiting: rc = 0 00000100:00100000:3.0:1789403351.122216:0:6508:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90a270180e00:6508] 0 exiting: rc = 1 00000100:00100000:0.0:1789403351.122410:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122417:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122422:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122427:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122433:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122438:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122443:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122456:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122462:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122467:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122472:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122477:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122481:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122487:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122492:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122497:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122502:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122506:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122511:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122516:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122521:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122536:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122542:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122547:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122553:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122557:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122572:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122577:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122582:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122587:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122591:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122596:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122601:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122605:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122610:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122615:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122620:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122740:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122749:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122754:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122759:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122764:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122769:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122773:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122778:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122783:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122788:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122793:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122799:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122803:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122808:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122813:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122817:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122821:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122826:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122830:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122843:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122848:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122853:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122858:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122862:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122867:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122872:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.122877:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403351.125147:0:6511:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff90a270180000:6511] 1 exiting: rc = 0 00000100:00100000:2.0:1789403351.125915:0:6510:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff90a270181800:6510] 0 exiting: rc = 1 00000100:00100000:0.0:1789403351.126013:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126021:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126026:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126032:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126037:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126043:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126049:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126054:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126060:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126065:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126072:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126076:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126082:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126087:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126092:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126097:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126102:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126107:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126112:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126117:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126123:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126129:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126134:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126139:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126143:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126148:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126153:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126172:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126178:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126183:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126188:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126193:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126198:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126202:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126207:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126212:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126217:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126222:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126227:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126231:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126236:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126253:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126260:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126264:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126340:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126346:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126351:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126357:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126362:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126367:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126372:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126377:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126381:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126415:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126423:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126428:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126433:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126438:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126443:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126886:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126895:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126900:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126915:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.126921:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403351.128117:0:6512:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff90a270181000:6512] 0 exiting: rc = 1 00000100:00100000:2.0:1789403351.128443:0:6514:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff90a2701aec00:6514] 2 exiting: rc = 0 00000100:00100000:3.0:1789403351.128837:0:6513:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff90a27a5f0c00:6513] 1 exiting: rc = 0 00000100:00100000:0.0:1789403351.128945:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128955:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128960:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128966:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128972:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128978:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128984:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128989:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.128995:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129000:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129006:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129011:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129016:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129022:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129028:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129033:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129039:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129044:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129049:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129055:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129061:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129067:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129072:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129089:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129095:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129100:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129105:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129111:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129116:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129121:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129126:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129132:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129140:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129156:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129161:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129166:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129171:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129176:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129182:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129188:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129193:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129198:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129204:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129209:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129215:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129220:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129226:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129256:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129263:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129328:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129338:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129342:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129348:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129353:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129358:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129364:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129369:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129375:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129381:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129413:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129420:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129425:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129430:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403351.129436:0:15438:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789403351.134765:0:15438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403351.134779:0:15438:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789403351.134784:0:15438:0:(genops.c:885:class_export_put()) final put ffff90a270142000/MDS_uuid 00000020:00000080:0.0:1789403351.134789:0:15438:0:(genops.c:844:class_export_destroy()) destroying export ffff90a270142000/MDS_uuid for MDS 00000020:01000000:0.0:1789403351.134812:0:15438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789403351.134965:0:15438:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789403351.538840:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403351.795908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403351.795918:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403351.795920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403351.795924:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789403351.795927:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a1421c3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403351.795935:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1789403351.795941:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789403351.795953:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a1421c3000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403351.795995:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418ce00 x1876325050775680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403351.796037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403351.796040:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789403351.796042:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403351.796046:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 392 00000100:00080000:0.0:1789403351.796048:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789403351.796053:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a14278f000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403351.796063:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418e300 x1876325050775936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403351.796213:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050775808:0@lo:400:kworker.0 00000400:00000100:3.0:1789403351.796261:0:3627:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050775808 offset 0 length 224: 4 00000100:00100000:0.0:1789403351.796856:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050775680:0@lo:38:kworker.0 00000400:00000100:0.0:1789403351.796884:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050775680 offset 0 length 520: 4 00000100:00100000:0.0:1789403351.796899:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050775936:0@lo:38:kworker.0 00000400:00000100:0.0:1789403351.796915:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050775936 offset 0 length 520: 4 00000100:00100000:0.0:1789403351.799543:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050776064:0@lo:400:kworker.0 00000400:00000100:0.0:1789403351.799606:0:3628:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776064 offset 0 length 224: 4 00010000:00010000:0.0:1789403352.565121:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403353.585803:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403354.611678:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789403354.652987:0:15639:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789403354.676121:0:15639:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789403354.676183:0:15639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403354.676199:0:15639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403354.676207:0:15639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403354.676215:0:15639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403354.676235:0:15639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789403354.676240:0:15639:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789403354.676264:0:15639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403354.676275:0:15639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418ce00 x1876325050775680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403366 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403354.676299:0:15639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789403354.676322:0:15639:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789403354.676328:0:15639:0:(import.c:65:import_set_state_nolock()) ffff90a1421c3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789403354.676333:0:15639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403354.676338:0:15639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418ce00 x1876325050775680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403366 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403354.676345:0:15639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789403354.676348:0:15639:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1789403354.676468:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403354.676482:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403354.676490:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403354.676494:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403354.676502:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403354.676510:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403354.676516:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403354.676519:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789403354.676521:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789403354.676545:0:8432:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:1.0:1789403354.676549:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403354.676556:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270184000/0x5fb08b1e5b760be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760be9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403354.676568:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403354.676570:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403354.676572:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403354.676764:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050775680:0@lo:38:kworker.0 00000100:00080000:3.0:1789403354.678157:0:15639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789403354.678172:0:15639:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418d880 x1876325050775808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403354.678199:0:15639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789403354.678205:0:15639:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789403354.678230:0:15639:0:(import.c:65:import_set_state_nolock()) ffff90a1421c0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789403354.678967:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050775808:0@lo:400:kworker.0 00000100:00100000:1.0:1789403354.679610:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050776192:0@lo:39:umount.0 00000400:00000100:1.0:1789403354.679676:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776192 offset 0 length 224: 4 00010000:00010000:0.0:1789403355.635369:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789403355.825629:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789403355.825640:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403355.825672:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789403355.825675:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403355.825940:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403355.825962:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050776320:0@lo:400:kworker.0 00000400:00000100:0.0:1789403355.826015:0:3628:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776320 offset 0 length 224: 4 00000001:00100000:2.0:1789403355.895788:0:8409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789403355.895798:0:8409:0:(genops.c:885:class_export_put()) final put ffff90a141b01800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789403355.896815:0:9495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789403355.896820:0:9495:0:(genops.c:885:class_export_put()) final put ffff90a1421c5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403355.897147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141b01800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789403355.897249:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a141b02800 for lustre-OST0000 00000020:00000080:1.0:1789403355.897328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789403355.897349:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27dbdb000 for lustre-OST0001 00010000:00010000:0.0:1789403356.659459:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403356.851235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403356.851257:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403356.851260:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403356.851263:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789403356.851441:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050776448:0@lo:400:kworker.0 00000400:00000100:1.0:1789403356.851500:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776448 offset 0 length 224: 4 00010000:00010000:3.0:1789403357.681832:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403358.708280:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403359.732311:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403360.756673:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403360.817847:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403350/real 1789403350] req@ffff90a144181c00 x1876325050775168/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789403360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403360.817881:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144181c00 x1876325050775168/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789403360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403360.817901:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a270141800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403360.817932:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789403360.817935:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3625:1876325050775168:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1789403360.818033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403360.818038:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789403360.818042:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a270141800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403360.818047:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 396 00000100:00080000:2.0:1789403360.818053:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789403360.818063:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff90a270141800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403360.818097:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e5180 x1876325050776576/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403360.818150:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3625:1876325050776576:0@lo:250:kworker.0 00000400:00000100:1.0:1789403360.818206:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876325050776576 offset 0 length 520: 4 00000100:00080000:2.0:1789403360.818341:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403360.818345:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403360.818527:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403360.818540:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050776704:0@lo:400:kworker.0 00000400:00000100:0.0:1789403360.818570:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776704 offset 0 length 224: 4 00010000:00010000:3.0:1789403361.777680:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403362.801632:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403363.826353:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403364.850698:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403364.913941:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403354/real 1789403354] req@ffff90a1442b6300 x1876325050776192/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403364.913975:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a1442b6300 x1876325050776192/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403364 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403364.914022:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1421c0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789403364.914044:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050776192:0@lo:39:umount.0 00000100:00080000:3.0:1789403364.914895:0:15639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789403364.914901:0:15639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789403364.914906:0:15639:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789403364.916035:0:15639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916052:0:15639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916060:0:15639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916067:0:15639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916117:0:15639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403364.916125:0:15639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916132:0:15639:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916138:0:15639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916144:0:15639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403364.916161:0:15639:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789403364.916166:0:15639:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1789403364.916479:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403364.916487:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916496:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403364.916500:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916509:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403364.916517:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403364.916522:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403364.916525:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789403364.916527:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789403364.916540:0:8432:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:1.0:1789403364.916544:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916551:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0c00/0x5fb08b1e5b760bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760bf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916565:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403364.916568:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916581:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403364.916584:0:8432:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916591:0:8432:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403364.916596:0:8432:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403364.916602:0:8432:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789403364.916604:0:8432:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789403364.916606:0:8432:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789403364.916611:0:8432:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:1.0:1789403364.916614:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916620:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144062000/0x5fb08b1e5b760e58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760e5f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403364.916630:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403364.916631:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403364.916633:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789403364.916843:0:15639:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789403364.916848:0:15639:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789403364.916852:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789403364.916858:0:15639:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789403364.916862:0:15639:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff90a245c98000) has no exports 00000020:00080000:3.0:1789403364.916885:0:15639:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff90a245c98000) has no exports 00010000:00010000:0.0:1789403364.917294:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789403364.922522:0:15639:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a1431949c0 - data ffff90a26db5b798/ffff90a281b99800 00000020:01000000:3.0:1789403364.922801:0:15639:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a142302a80 - data ffff90a26d9e5000/ffff90a281bafc00 00100000:10000000:3.0:1789403364.933186:0:15639:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789403364.956138:0:15639:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760934 00000020:00000080:2.0:1789403364.956149:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a27a74b000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789403364.956182:0:15639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a27b560000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789403364.956186:0:15639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a27b560000 2 00000020:01000004:2.0:1789403364.956189:0:15639:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a27b560000 from lustre-OST0000 00000020:00000080:2.0:1789403364.956229:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403364.956240:0:15639:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789403364.956243:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a2473fd000/lustre-OST0000_UUID 00000020:00000080:2.0:1789403364.956246:0:15639:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2473fd000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789403364.956266:0:15639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789403364.956317:0:15639:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789403364.956321:0:15639:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789403364.956325:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403364.956330:0:15639:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789403364.956337:0:15639:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90a1421c3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789403364.956344:0:15639:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff90a281ae3380) has exports, disconnecting them 00000020:00080000:2.0:1789403364.956348:0:15639:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90a1421c3800), last request at 1789403137 00000020:00000080:2.0:1789403364.956352:0:15639:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76095e 00000020:00080000:2.0:1789403364.956363:0:15639:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1421c3800): rc 0 00000020:00000080:2.0:1789403364.956368:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a1421c3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789403364.956996:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27a74b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789403364.957013:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789403364.959662:0:15639:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789403364.959670:0:15639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789403364.959674:0:15639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789403364.959680:0:15639:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403364.959927:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1421c3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789403364.959983:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403364.959992:0:15639:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789403364.960011:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a141b03800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789403364.960015:0:15639:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141b03800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789403364.960028:0:15639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789403364.960095:0:15639:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789403364.960099:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403364.960103:0:15639:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789403364.960109:0:15639:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90a1421c1000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789403364.960117:0:15639:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff90a281ae4d40) has exports, disconnecting them 00000020:00080000:1.0:1789403364.960121:0:15639:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90a1421c1000), last request at 1789403137 00000020:00000080:1.0:1789403364.960124:0:15639:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760973 00000020:00080000:1.0:1789403364.960136:0:15639:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1421c1000): rc 0 00000020:00000080:1.0:1789403364.960140:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a1421c1000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789403364.960562:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c1000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789403364.964690:0:15639:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789403364.964708:0:15639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403364.964712:0:15639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403364.964721:0:15639:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403364.964748:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1421c0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789403364.964944:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403364.964953:0:15639:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789403364.964959:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a1421c0800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789403364.964962:0:15639:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c0800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789403364.964969:0:15639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789403364.965037:0:15639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a27b560000 1 00000020:00000080:0.0:1789403364.965044:0:15639:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7608fc 00000020:00000080:0.0:1789403364.965050:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a246f48800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789403364.965058:0:15639:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789403364.965066:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f48800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789403364.965075:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403364.965080:0:15639:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403364.965083:0:15639:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff90a281873380) has no exports 00000020:00000080:1.0:1789403365.077595:0:15639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403365.077610:0:15639:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789403365.077616:0:15639:0:(genops.c:885:class_export_put()) final put ffff90a27c35f800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789403365.077621:0:15639:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c35f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789403365.077631:0:15639:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789403365.077787:0:15639:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a27c35b000 00000020:02000400:1.0:1789403365.077849:0:15639:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789403365.873983:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789403366.131326:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403366.131337:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403366.131340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403366.131344:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403366.131420:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403366.131438:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050776832:0@lo:400:kworker.0 00000400:00000100:2.0:1789403366.131500:0:3629:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776832 offset 0 length 224: 4 00010000:00010000:1.0:1789403366.905495:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403366.963507:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403351/real 1789403351] req@ffff90a14418e300 x1876325050775936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789403366 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403366.963543:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a14418e300 x1876325050775936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789403366 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403366.963563:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403366.963583:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789403366.963587:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050775936:0@lo:38:kworker.0 00000100:00080000:2.0:1789403366.963813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403366.963828:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403366.963831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403366.963834:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789403366.963837:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403366.963841:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 397 00000100:00080000:2.0:1789403366.963846:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789403366.963873:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a14278f000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403366.963905:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e6300 x1876325050776960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403366.964027:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050776960:0@lo:38:kworker.0 00000400:00000100:1.0:1789403366.964074:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050776960 offset 0 length 520: 4 00000100:00000400:0.0:1789403367.157351:0:3628:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403351/real 1789403351] req@ffff90a14418f100 x1876325050776064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403367 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403367.169717:0:3628:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff90a14418f100 x1876325050776064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403367 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789403367.169744:0:3628:0:(import.c:65:import_set_state_nolock()) ffff90a14338c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789403367.169747:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789403367.174703:0:3628:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1789403367.174772:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050776064:0@lo:400:kworker.0 00000100:00080000:2.0:1789403367.174832:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403367.174837:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403367.174839:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403367.174842:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403367.174844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789403367.174847:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789403367.174850:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a14338c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403367.174855:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:2.0:1789403367.174868:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a14338c000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403367.174899:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e4380 x1876325050777088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403367.174967:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050777088:0@lo:38:kworker.0 00000400:00000100:0.0:1789403367.175012:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050777088 offset 0 length 520: 4 00010000:00010000:1.0:1789403367.935189:0:8432:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789403368.686248:0:15841:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789403368.704333:0:15841:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789403368.704560:0:15841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403368.704575:0:15841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403368.704599:0:15841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403368.704605:0:15841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403368.705013:0:15841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789403368.705020:0:15841:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789403368.705046:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403368.705059:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e6300 x1876325050776960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.705081:0:15841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789403368.705088:0:15841:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789403368.705094:0:15841:0:(import.c:65:import_set_state_nolock()) ffff90a14278f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789403368.705099:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403368.705103:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e6300 x1876325050776960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403386 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.705110:0:15841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789403368.705112:0:15841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1789403368.705238:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050776960:0@lo:38:kworker.0 00000100:00080000:3.0:1789403368.707208:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789403368.707225:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144180e00 x1876325050776320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403371 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.707298:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418d880 x1876325050776448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.707322:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e7800 x1876325050776704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403376 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.707331:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e4a80 x1876325050776832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.707362:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e4380 x1876325050777088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403377 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.707373:0:15841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789403368.707438:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050776832:0@lo:400:kworker.0 00000100:00080000:3.0:1789403368.707467:0:15841:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789403368.707473:0:15841:0:(import.c:65:import_set_state_nolock()) ffff90a14338c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789403368.707478:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789403368.707482:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144180e00 x1876325050776320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403371 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403368.707535:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050776704:0@lo:400:kworker.0 00010000:00010000:0.0:1789403368.707640:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403368.707649:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403368.707659:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403368.707663:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403368.707672:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403368.707679:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403368.707685:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403368.707688:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789403368.707700:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789403368.707712:0:6488:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:0.0:1789403368.707716:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403368.707734:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04200/0x5fb08b1e5b760bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760bcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403368.707930:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050776320:0@lo:400:kworker.0 00000100:00100000:3.0:1789403368.708022:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a14418d880 x1876325050776448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403372 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.708032:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e7800 x1876325050776704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403376 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.708039:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e4380 x1876325050777088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403377 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403368.708045:0:15841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789403368.708076:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050776448:0@lo:400:kworker.0 00000100:00100000:2.0:1789403368.708105:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050777088:0@lo:38:kworker.0 00010000:00010000:1.0:1789403368.708230:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403368.708233:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403368.708235:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403368.708257:0:15841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789403368.718544:0:15841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718563:0:15841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718585:0:15841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718592:0:15841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718623:0:15841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403368.718631:0:15841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718638:0:15841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718644:0:15841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718650:0:15841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.718665:0:15841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789403368.718670:0:15841:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789403368.718811:0:15841:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789403368.718815:0:15841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789403368.718820:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403368.718825:0:15841:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789403368.718829:0:15841:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff90a27c363380) has no exports 00000020:00080000:2.0:1789403368.719556:0:15841:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff90a27c363380) has no exports 00010000:00010000:1.0:1789403368.720253:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403368.720263:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720282:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403368.720287:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720297:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403368.720305:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403368.720311:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403368.720314:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789403368.720317:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789403368.720331:0:6489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:1.0:1789403368.720335:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720362:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b760bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760bdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720378:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403368.720381:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720415:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403368.720419:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720438:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403368.720445:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403368.720450:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789403368.720453:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789403368.720455:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789403368.720460:0:6489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:1.0:1789403368.720463:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720470:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0a00/0x5fb08b1e5b760e4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760e51 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403368.720483:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403368.720485:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403368.720492:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403368.720621:0:8431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789403368.728523:0:15841:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a142505ae0 - data ffff90a26db5eaf8/ffff90a277b9bc00 00000020:01000000:2.0:1789403368.729784:0:15841:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a142505900 - data ffff90a26da8a438/ffff90a1434d0000 00100000:10000000:3.0:1789403368.750327:0:15841:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789403368.759576:0:15841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a5a 00000020:00000080:2.0:1789403368.759589:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a1421c4000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789403368.759605:0:15841:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a1424b5800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789403368.759608:0:15841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a1424b5800 2 00000020:01000004:2.0:1789403368.759621:0:15841:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a1424b5800 from lustre-OST0001 00000020:00000080:2.0:1789403368.759643:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403368.759653:0:15841:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789403368.759656:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a141a3b800/lustre-OST0001_UUID 00000020:00000080:2.0:1789403368.759659:0:15841:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141a3b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789403368.759665:0:15841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789403368.759786:0:15841:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ffb2a5d6-5856-4505-b5af-5b30dcef2165->MGS 00010000:00010000:2.0:1789403368.759803:0:15841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7607b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403368.759815:0:15841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7607b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403368.759822:0:15841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789403368.759824:0:15841:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789403368.759828:0:15841:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789403368.759845:0:15841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:2.0:1789403368.759849:0:15841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7607b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b7607ba expref: -99 pid: 7429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403368.759863:0:15841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403368.759870:0:15841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403368.759875:0:15841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789403368.759885:0:15841:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789403368.759886:0:15841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789403368.759895:0:15841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a270141800 00010000:00010000:2.0:1789403368.759898:0:15841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1e00/0x5fb08b1e5b760c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b760c3d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789403368.759913:0:15841:0:(import.c:65:import_set_state_nolock()) ffff90a270141800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789403368.759917:0:15841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789403368.759919:0:15841:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789403368.759920:0:15841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789403368.759924:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789403368.759935:0:15841:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a1443e5180 x1876325050776576/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789403375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789403368.759951:0:15841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789403368.759953:0:15841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1789403368.759983:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ffb2a5d6-5856-4505-b5af-5b30dcef2165:3625:1876325050776576:0@lo:250:kworker.0 10000000:01000000:2.0:1789403368.760007:0:15841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789403368.760013:0:15841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7606b0 00000020:00000080:2.0:1789403368.760018:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a270141000/ffb2a5d6-5856-4505-b5af-5b30dcef2165 00000020:01000000:2.0:1789403368.760023:0:15841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.143@tcp (flags='') 00000020:00000080:2.0:1789403368.760028:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403368.760032:0:15841:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403368.760036:0:15841:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff90a245c9b380) has no exports 00000020:00000080:0.0:1789403368.760177:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1421c4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789403368.760191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a270141000/ffb2a5d6-5856-4505-b5af-5b30dcef2165 for MGC192.168.203.143@tcp 10000000:01000000:3.0:1789403368.760412:0:6497:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789403368.760642:0:15841:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.143@tcp: client import never connected 00000100:00080000:2.0:1789403368.760645:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789403368.760648:0:15841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789403368.760650:0:15841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789403368.760652:0:15841:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789403368.760705:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403368.760710:0:15841:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.143@tcp (uuid ffb2a5d6-5856-4505-b5af-5b30dcef2165) 00000020:01000000:2.0:1789403368.760715:0:15841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789403368.760718:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403368.760729:0:15841:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789403368.760734:0:15841:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90a142788800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789403368.760740:0:15841:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff90a14264b380) has exports, disconnecting them 00000020:00080000:2.0:1789403368.760744:0:15841:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90a142788800), last request at 1789403157 00000020:00000080:2.0:1789403368.760748:0:15841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a84 00000020:00080000:2.0:1789403368.760758:0:15841:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a142788800): rc 0 00000020:00000080:2.0:1789403368.760762:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a142788800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789403368.761467:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a270141800 for MGC192.168.203.143@tcp 00000020:00000080:0.0:1789403368.761476:0:37:0:(genops.c:885:class_export_put()) final put ffff90a270144800/ffb2a5d6-5856-4505-b5af-5b30dcef2165 00000020:00000080:0.0:1789403368.761479:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a270144800/ffb2a5d6-5856-4505-b5af-5b30dcef2165 for MGC192.168.203.143@tcp 00000020:01000000:0.0:1789403368.761483:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.143@tcp (ffb2a5d6-5856-4505-b5af-5b30dcef2165) 00000020:00000080:0.0:1789403368.761729:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a142788800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789403368.767487:0:15841:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789403368.767495:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403368.767499:0:15841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403368.767507:0:15841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403368.767727:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403368.767738:0:15841:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789403368.767744:0:15841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789403368.767748:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403368.767752:0:15841:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789403368.767760:0:15841:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90a14338f000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403368.767766:0:15841:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff90a14264cd40) has exports, disconnecting them 00000020:00080000:0.0:1789403368.767771:0:15841:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90a14338f000), last request at 1789403157 00000020:00000080:0.0:1789403368.767776:0:15841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a99 00000020:00080000:0.0:1789403368.767791:0:15841:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a14338f000): rc 0 00000020:00000080:0.0:1789403368.767797:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a14338f000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789403368.768011:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14278f000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789403368.768019:0:37:0:(genops.c:885:class_export_put()) final put ffff90a14278b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789403368.768022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14278b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789403368.768033:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789403368.768104:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14338f000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789403368.769657:0:15841:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789403368.769664:0:15841:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789403368.769668:0:15841:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789403368.769674:0:15841:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789403368.769703:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14338c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789403368.769749:0:8432:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789403368.769871:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789403368.769933:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789403368.769998:0:8431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789403368.770098:0:6483:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90a251283a00:6483] 0 exiting: rc = 1 00000100:00100000:1.0:1789403368.770160:0:6484:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90a242d93a00:6484] 1 exiting: rc = 0 00000100:00100000:1.0:1789403368.771772:0:10379:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff90a281b49e00:10379] 2 exiting: rc = 0 00000100:00100000:1.0:1789403368.771873:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.772179:0:6487:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90a251282e00:6487] 2 exiting: rc = 0 00000100:00100000:1.0:1789403368.772323:0:7451:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90a281a27600:7451] 3 exiting: rc = 0 00000100:00100000:1.0:1789403368.772415:0:6485:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90a251282800:6485] 0 exiting: rc = 1 00000100:00100000:1.0:1789403368.772494:0:6486:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90a251283600:6486] 1 exiting: rc = 0 00000100:00100000:2.0:1789403368.773832:0:10319:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90a14369d000:10319] 4 exiting: rc = 0 00000100:00100000:1.0:1789403368.773957:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.773993:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.773999:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774052:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774061:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774067:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774073:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774093:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774099:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774105:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774111:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774117:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774122:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774129:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774277:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774286:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774292:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774298:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774307:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774314:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774320:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774324:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774330:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774335:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774340:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774345:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774350:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774354:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774359:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774363:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774368:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774373:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774378:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774383:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774413:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774418:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774423:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774438:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774442:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774448:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774453:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774457:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774470:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774475:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774480:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774484:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774488:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774492:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774497:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774501:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774505:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774510:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774515:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774519:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774523:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774527:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774531:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774536:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774540:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774544:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774548:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774553:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774558:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.774563:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789403368.777070:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403368.777085:0:15841:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789403368.777091:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a281b13000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789403368.777096:0:15841:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281b13000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789403368.777102:0:15841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789403368.777320:0:15841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a1424b5800 1 00000020:00000080:1.0:1789403368.777328:0:15841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b760a29 00000020:00000080:1.0:1789403368.777345:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a141b00800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789403368.777359:0:15841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789403368.777371:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141b00800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789403368.777383:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403368.777419:0:15841:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789403368.777423:0:15841:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff90a1426499c0) has no exports 00000020:00000080:0.0:1789403368.879021:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403368.879052:0:15841:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789403368.879059:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a1424b4800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789403368.879065:0:15841:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1424b4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789403368.879073:0:15841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789403368.880275:0:15841:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a1424b1000 00000020:01000000:0.0:1789403368.880305:0:15841:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789403368.880311:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403368.880317:0:15841:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403368.880321:0:15841:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff90a27c3619c0) has no exports 00000020:00000080:0.0:1789403368.880635:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403368.880743:0:15841:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789403368.880748:0:15841:0:(genops.c:885:class_export_put()) final put ffff90a246f4d800/OSS_uuid 00000020:00000080:0.0:1789403368.880751:0:15841:0:(genops.c:844:class_export_destroy()) destroying export ffff90a246f4d800/OSS_uuid for OSS 00000020:01000000:0.0:1789403368.880757:0:15841:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789403368.880982:0:6496:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789403368.881161:0:8417:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff90a27c209a00:8417] 2 exiting: rc = 0 00000100:00100000:1.0:1789403368.881296:0:8563:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff90a274c95200:8563] 3 exiting: rc = 0 00000100:00100000:1.0:1789403368.881373:0:8415:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff90a274c94a00:8415] 0 exiting: rc = 1 00000100:00100000:3.0:1789403368.881681:0:8416:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff90a274c95c00:8416] 1 exiting: rc = 0 00000100:00100000:0.0:1789403368.881871:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881880:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881887:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881894:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881901:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881906:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881911:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881916:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881921:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881926:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881932:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881937:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881942:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881948:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881953:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881958:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881963:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881967:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881972:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881977:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.881996:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882001:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882005:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882010:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882015:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882021:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882027:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882032:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882036:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882041:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882046:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882052:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882057:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882062:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882067:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882073:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882079:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882084:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882089:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882106:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882112:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882117:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882124:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882129:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882144:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882151:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882157:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882162:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882168:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882173:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882179:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882184:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882200:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882212:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882222:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882235:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882241:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882246:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882252:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882258:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882264:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882270:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882275:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.882281:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.884764:0:10332:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90a14369f400:10332] 2 exiting: rc = 0 00000100:00100000:1.0:1789403368.885057:0:8419:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90a274d30e00:8419] 1 exiting: rc = 0 00000100:00100000:0.0:1789403368.885296:0:8418:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90a274d31000:8418] 0 exiting: rc = 1 00000100:00100000:2.0:1789403368.885744:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885761:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885769:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885774:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885784:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885789:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885794:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885799:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885805:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885811:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885816:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885821:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885826:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885832:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885837:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885842:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885847:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885852:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885858:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885863:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885869:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885874:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885896:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885901:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885907:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885912:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885917:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885922:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885928:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885932:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885937:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885942:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885947:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885952:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885956:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885961:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885967:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885972:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885976:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885981:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885985:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885989:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885994:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.885999:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886004:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886008:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886012:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886017:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886021:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886026:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886031:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886035:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886047:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886053:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886058:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886063:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886067:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886078:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886087:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886093:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886099:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886104:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886108:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.886114:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403368.888307:0:8422:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90a24739e800:8422] 2 exiting: rc = 0 00000100:00100000:0.0:1789403368.888681:0:8421:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90a274d31800:8421] 1 exiting: rc = 0 00000100:00100000:1.0:1789403368.888992:0:8420:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90a274d31200:8420] 0 exiting: rc = 1 00000100:00100000:3.0:1789403368.889489:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889497:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889502:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889508:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889514:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889534:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889539:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889545:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889550:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889555:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889561:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889567:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889573:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889579:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889584:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889590:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889595:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889601:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889606:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889612:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889632:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889639:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889754:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889763:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889769:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889775:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889782:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889788:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889794:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889800:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889805:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889811:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889816:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889822:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889827:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889833:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889839:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889845:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889850:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889856:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889869:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889874:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889879:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889884:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889903:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889909:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889915:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889920:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889926:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889931:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889937:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889942:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889948:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889953:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889966:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889981:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889993:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.889999:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.890005:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.890020:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.890027:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.890034:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.890040:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.890046:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.898561:0:8424:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90a281862e00:8424] 1 exiting: rc = 0 00000100:00100000:1.0:1789403368.899350:0:8423:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90a274ca7400:8423] 0 exiting: rc = 1 00000100:00100000:3.0:1789403368.899631:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899639:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899750:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899759:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899765:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899770:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899775:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899780:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899786:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899791:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899797:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899822:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899829:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899835:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899840:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899845:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899850:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899855:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899860:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899865:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899870:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899875:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899880:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899885:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899891:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899896:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899901:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899906:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899912:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899917:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899922:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899927:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899932:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899937:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899942:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899946:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899950:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899955:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899960:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899965:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899970:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899974:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899978:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899984:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899990:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.899994:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900006:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900011:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900016:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900034:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900040:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900045:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900050:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900056:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900061:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900067:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900072:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900077:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900083:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900088:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900093:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900098:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900103:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403368.900109:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403368.902845:0:8425:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90a274cfc000:8425] 0 exiting: rc = 1 00000100:00100000:2.0:1789403368.903384:0:8426:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90a274cfde00:8426] 1 exiting: rc = 0 00000100:00100000:1.0:1789403368.903965:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.903973:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.903987:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.903993:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.903999:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904004:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904010:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904016:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904022:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904027:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904033:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904053:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904060:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904065:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904071:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904089:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904095:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904101:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904106:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904113:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904119:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904125:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904131:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904160:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904167:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904172:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904178:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904196:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904202:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904208:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904215:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904222:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904228:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904233:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904239:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904257:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904263:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904270:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904276:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904281:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904288:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904296:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904302:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904310:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904317:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904323:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904330:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904353:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904370:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904376:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904381:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904412:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904419:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904434:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904441:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904448:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904453:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904459:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904464:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904485:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904493:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904499:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904511:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403368.904526:0:15841:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789403368.918041:0:15841:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789403385.344090:0:16604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789403393.164996:0:17203:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789403393.165002:0:17203:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789403393.165003:0:17203:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789403393.165109:0:17203:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a14452d000 00000020:01000004:1.0:1789403393.165125:0:17203:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789403393.165132:0:17203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789403393.165145:0:17203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90a245c9b380) 00000020:00000080:1.0:1789403393.165158:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403393.247265:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789403393.247827:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789403393.248517:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789403393.248736:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789403393.248980:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789403393.249491:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789403393.249705:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789403393.249919:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789403393.250124:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789403393.250560:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789403393.250743:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789403393.250957:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789403393.251296:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789403393.251513:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789403393.254272:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.254537:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.254721:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.254902:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.255127:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.255435:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.255649:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.255839:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.256029:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.256324:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.256603:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.256886:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.257075:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.257477:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.257714:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.257900:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.258357:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.258675:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.258859:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.259077:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.259318:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.259517:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.259734:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.260003:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.260325:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.260625:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.260806:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.261515:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.265350:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.269629:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789403393.269919:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789403393.270683:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789403393.274325:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789403393.275329:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1789403393.275987:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1789403393.276281:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1789403393.277002:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789403393.277273:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1789403393.277541:0:17203:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1789403393.278675:0:17203:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789403393.278885:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789403393.278893:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789403393.278902:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761c5f 00000020:01000004:0.0:1789403393.278909:0:17203:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789403393.278913:0:17203:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789403393.278918:0:17203:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a14452d000 from MGS 00000020:01000004:0.0:1789403393.278921:0:17203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789403393.278930:0:17203:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90a1426499c0) 00000020:00000080:0.0:1789403393.278939:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789403393.279021:0:17203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a14452d000 from MGS, refs=2 00080000:01000000:0.0:1789403393.279026:0:17203:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789403393.279030:0:17203:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761c6d 00000100:00100000:0.0:1789403393.279116:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789403393.279261:0:17203:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789403393.279267:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789403393.280164:0:17203:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789403393.280172:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789403393.280941:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.281107:0:17203:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789403393.281112:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789403393.281943:0:17203:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789403393.282004:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789403393.282615:0:17203:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789403393.282621:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789403393.283270:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.283274:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.283276:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.283694:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.283697:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.283698:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403393.284304:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789403393.288262:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789403393.291847:0:17203:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789403393.292905:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789403393.293018:0:17203:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789403393.293055:0:17203:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789403393.293804:0:17203:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789403393.294703:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.299892:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789403393.299906:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789403393.300500:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789403393.300508:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789403393.302714:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789403393.302728:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789403393.304274:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789403393.304298:0:17203:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:0.0:1789403393.304300:0:17203:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789403393.304331:0:17203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:0.0:1789403393.304344:0:17203:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (ffff90a142648000) 00000020:00000080:0.0:1789403393.304361:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1789403393.304534:0:17220:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1789403393.304628:0:17203:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a2599a1000@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403393.304791:0:17203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:0.0:1789403393.304798:0:17203:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789403393.305276:0:17221:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789403393.305343:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid 41b7c44b-9a12-452a-b9e6-b5b285399ec4) 00000020:00000080:1.0:1789403393.305360:0:17203:0:(genops.c:1384:class_connect()) connect: client 41b7c44b-9a12-452a-b9e6-b5b285399ec4, cookie 0x5fb08b1e5b761c7b 00000100:00080000:1.0:1789403393.305370:0:17203:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403393.305379:0:17203:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff90a2599a1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403393.305445:0:17203:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144180700 x1876325050777216/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403393.305495:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3625:1876325050777216:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789403393.305562:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403393.305621:0:17203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS 00000020:01000004:1.0:1789403393.305639:0:17203:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789403393.305644:0:17203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789403393.305654:0:17203:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90a245c98000) 00000020:00000080:1.0:1789403393.305665:0:17203:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789403393.305800:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777216 00000100:00100000:3.0:1789403393.305808:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777216 00000100:00100000:3.0:1789403393.305836:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403393.305843:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3625:x1876325050777216:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789403393.305873:0:17217:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 41b7c44b-9a12-452a-b9e6-b5b285399ec4@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1789403393.305893:0:17217:0:(genops.c:1384:class_connect()) connect: client 41b7c44b-9a12-452a-b9e6-b5b285399ec4, cookie 0x5fb08b1e5b761c89 00000100:00080000:3.0:1789403393.306022:0:17217:0:(import.c:65:import_set_state_nolock()) ffff90a1442c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403393.306082:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+5:3625:x1876325050777216:12345-0@lo:250:mount.lustre.0 Request processed in 238us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.306089:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403393.306205:0:3625:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789403393.306215:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:0.0:1789403393.306228:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789403393.306232:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789403393.306235:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2599a1000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789403393.306238:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789403393.306263:0:3625:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789403393.306269:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3625:1876325050777216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789403393.328881:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.329071:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789403393.329077:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789403393.332629:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789403393.332641:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789403393.332946:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789403393.332953:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789403393.333886:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.334064:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789403393.334070:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789403393.334756:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789403393.334763:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789403393.363924:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403393.364109:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789403393.364116:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789403393.365131:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789403393.365139:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789403393.366035:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.366276:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789403393.366281:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789403393.366907:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789403393.366915:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789403393.367830:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.367989:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789403393.367994:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789403393.368611:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789403393.368618:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789403393.369299:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.369608:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789403393.369614:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789403393.370013:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789403393.370019:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789403393.387417:0:17203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403393.387624:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789403393.387631:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789403393.388534:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789403393.388544:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789403393.389230:0:17203:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789403393.389237:0:17203:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789403393.390343:0:17203:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789403393.390373:0:17203:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789403393.390379:0:17203:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789403393.390622:0:17203:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789403393.390658:0:17203:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789403393.390662:0:17203:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789403393.390664:0:17203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403393.390665:0:17203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403393.390666:0:17203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403393.390667:0:17203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403393.390669:0:17203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403393.390670:0:17203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403393.390671:0:17203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403393.390673:0:17203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403393.390675:0:17203:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403393.390678:0:17203:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789403393.390680:0:17203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403393.390681:0:17203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403393.390683:0:17203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403393.390684:0:17203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403393.390685:0:17203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403393.390686:0:17203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403393.390687:0:17203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403393.390688:0:17203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403393.390689:0:17203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403393.390691:0:17203:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403393.390717:0:17203:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789403393.390736:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789403393.390811:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.391026:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403393.391086:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777344 00000100:00100000:2.0:1789403393.391093:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777344 00000100:00100000:2.0:1789403393.391158:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403393.391165:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+5:17203:x1876325050777344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789403393.391202:0:17219:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789403393.391203:0:17219:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789403393.391205:0:17219:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789403393.391576:0:17240:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789403393.391941:0:17219:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1789403393.393132:0:17241:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789403393.393138:0:17241:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789403393.393141:0:17241:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789403393.393144:0:17241:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789403393.393693:0:17241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789403393.394039:0:17219:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789403393.394049:0:17219:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789403393.395591:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+5:17203:x1876325050777344:12345-0@lo:253:mount.lustre.0 Request processed in 4419us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403393.395610:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403393.395670:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789403393.395687:0:17203:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789403393.395695:0:17203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789403393.395697:0:17203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789403393.395698:0:17203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403393.395700:0:17203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403393.395701:0:17203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403393.395702:0:17203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403393.395703:0:17203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403393.395705:0:17203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789403393.395706:0:17203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403393.395708:0:17203:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789403393.395728:0:17203:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a14452d000 from lustre-MDT0000 10000000:01000000:0.0:1789403393.395754:0:17203:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789403393.395757:0:17203:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789403393.395761:0:17203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a142648000 10000000:01000000:0.0:1789403393.395765:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789403393.395772:0:17203:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a142648000 from 1 10000000:01000000:0.0:1789403393.395775:0:17203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789403393.395808:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.395818:0:17203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.395827:0:17203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.395855:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403393.395887:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.396065:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403393.396078:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777472 00000100:00100000:3.0:1789403393.396085:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777472 00000100:00100000:3.0:1789403393.396126:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403393.396136:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+5:17203:x1876325050777472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403393.396149:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403393.396163:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947600/0x5fb08b1e5b761c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761c90 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.396189:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947600/0x5fb08b1e5b761c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761c90 expref: 6 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.396200:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947600/0x5fb08b1e5b761c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761c90 expref: 6 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.396207:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947600, rc 0) 00000100:00100000:3.0:1789403393.396258:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+6:17203:x1876325050777472:12345-0@lo:101:mount.lustre.0 Request processed in 124us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.396264:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403393.396365:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403393.396378:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.396465:0:17203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.396531:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403393.396556:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.396582:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403393.396731:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777600 00000100:00100000:1.0:1789403393.396736:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777600 00000100:00100000:1.0:1789403393.396768:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403393.396776:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+6:17203:x1876325050777600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403393.396959:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+6:17203:x1876325050777600:12345-0@lo:501:mount.lustre.0 Request processed in 173us (391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403393.396966:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403393.397115:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777600:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789403393.397149:0:17203:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789403393.397203:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.397212:0:17203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403393.397220:0:17203:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a14452d000 10000000:01000000:0.0:1789403393.397224:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789403393.397228:0:17203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a14452d000 10000000:01000000:0.0:1789403393.397230:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789403393.397233:0:17203:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a14452d000 from 1 10000000:01000000:0.0:1789403393.397250:0:17203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789403393.397268:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.397275:0:17203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.397284:0:17203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.397298:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403393.397324:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.397346:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403393.397416:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777728 00000100:00100000:2.0:1789403393.397421:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777728 00000100:00100000:2.0:1789403393.397456:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403393.397463:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+6:17203:x1876325050777728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403393.397472:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403393.397484:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c7000/0x5fb08b1e5b761ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761c9e expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.397499:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c7000/0x5fb08b1e5b761ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761c9e expref: 7 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.397507:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c7000/0x5fb08b1e5b761ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761c9e expref: 7 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.397515:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7000, rc 0) 00000100:00100000:2.0:1789403393.397553:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+7:17203:x1876325050777728:12345-0@lo:101:mount.lustre.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403393.397568:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403393.397683:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403393.397695:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403393.397703:0:17203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403393.397714:0:17203:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789403393.397815:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403393.397824:0:17203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403393.397830:0:17203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789403393.397834:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403393.397838:0:17203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a14452d000 10000000:01000000:1.0:1789403393.397841:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789403393.397844:0:17203:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789403393.397846:0:17203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789403393.397861:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403393.397873:0:17203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403393.397881:0:17203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403393.397892:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789403393.397915:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.397940:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789403393.398105:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777856 00000100:00100000:2.0:1789403393.398110:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777856 00000100:00100000:2.0:1789403393.398174:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403393.398181:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+7:17203:x1876325050777856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403393.398188:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403393.398196:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c7c00/0x5fb08b1e5b761cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761cac expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.398209:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c7c00/0x5fb08b1e5b761cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761cac expref: 8 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.398217:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c7c00/0x5fb08b1e5b761cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761cac expref: 8 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.398224:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7c00, rc 0) 00000100:00100000:2.0:1789403393.398265:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+8:17203:x1876325050777856:12345-0@lo:101:mount.lustre.0 Request processed in 85us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403393.398272:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403393.398326:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403393.398337:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403393.398345:0:17203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403393.398411:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403393.398457:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.398699:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.398752:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050777984 00000100:00100000:0.0:1789403393.398757:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050777984 00000100:00100000:0.0:1789403393.398776:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403393.398782:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+8:17203:x1876325050777984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403393.398918:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17203:x1876325050777984:12345-0@lo:501:mount.lustre.0 Request processed in 135us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403393.398924:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403393.399058:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050777984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403393.399084:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050778112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403393.399118:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.399137:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281b1c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.399185:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050778112 00000100:00100000:0.0:1789403393.399189:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050778112 00000100:00100000:0.0:1789403393.399208:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403393.399214:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17203:x1876325050778112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403393.399787:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17203:x1876325050778112:12345-0@lo:503:mount.lustre.0 Request processed in 571us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403393.399794:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789403393.400008:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050778112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403393.400336:0:17242:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17242:1876325050778240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403393.400375:0:17242:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403393.400460:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245cadf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403393.400501:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050778240 00000100:00100000:3.0:1789403393.400507:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050778240 00000100:00100000:0.0:1789403393.400576:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403393.400705:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17242:x1876325050778240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403393.401285:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17242:x1876325050778240:12345-0@lo:502:llog_process_th.0 Request processed in 694us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403393.401293:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403393.401372:0:17242:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17242:1876325050778240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789403393.401562:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403393.401573:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.401576:0:17242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789403393.401581:0:17242:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789403393.401590:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403393.401605:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90a1425d4d40) 00000020:00000080:2.0:1789403393.401621:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789403393.401627:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789403393.401697:0:17242:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789403393.401704:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761cc1 00000020:00000080:2.0:1789403393.401899:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789403393.401903:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403393.401906:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.401907:0:17242:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789403393.401910:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403393.401913:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.401914:0:17242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789403393.401917:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403393.401925:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90a1425d0000) 00000020:00000080:2.0:1789403393.401933:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789403393.401937:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789403393.401939:0:17242:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789403393.401941:0:17242:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789403393.401946:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789403393.402056:0:17242:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a14452d000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789403393.402069:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90a1425d19c0) 00000020:00000080:2.0:1789403393.402079:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789403393.402137:0:17242:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789403393.402155:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b761cd6 00000020:00000080:2.0:1789403393.402235:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789403393.402251:0:17242:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789403393.402256:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb08b1e5b761cdd 00080000:01000000:2.0:1789403393.402262:0:17242:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789403393.402265:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761ce4 00010000:00010000:0.0:1789403393.472612:0:17242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789403393.473282:0:17242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1789403393.473952:0:17242:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789403393.474424:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90a14264cd40) 00000020:00000080:0.0:1789403393.474442:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789403393.474518:0:17242:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789403393.474524:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761cf2 00000020:00000080:1.0:1789403393.476252:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789403393.483851:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb08b1e5b761cf9 00000020:00000080:1.0:1789403393.484512:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789403393.484523:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.484530:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.484532:0:17242:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789403393.484536:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403393.484538:0:17242:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789403393.484540:0:17242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403393.484541:0:17242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403393.484543:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403393.484545:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.484547:0:17242:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403393.484560:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403393.484566:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.484567:0:17242:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789403393.484572:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789403393.484615:0:17242:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789403393.484635:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.484638:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.484639:0:17242:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789403393.484643:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403393.484646:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.484647:0:17242:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789403393.484650:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789403393.484656:0:17242:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:1.0:1789403393.484681:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403393.484695:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90a245c9cd40) 00000020:00000080:1.0:1789403393.484708:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789403393.484720:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789403393.484767:0:17242:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789403393.484772:0:17242:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789403393.484776:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761d07 00010000:00080000:1.0:1789403393.484800:0:17242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1436b4000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403393.488610:0:17242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789403393.490091:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403393.490105:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789403393.490142:0:17242:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789403393.490162:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b761d0e 00000100:00080000:1.0:1789403393.490173:0:17242:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403393.490184:0:17242:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a1436b4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403393.490224:0:17242:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144181c00 x1876325050778368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403393.490261:0:17242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789403393.490350:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050778368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403393.490464:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789403393.490621:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.490625:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.490627:0:17242:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789403393.490630:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403393.490633:0:17242:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789403393.490634:0:17242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403393.490636:0:17242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403393.490638:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403393.490640:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.490641:0:17242:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403393.490644:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403393.490648:0:17242:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789403393.490652:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.490653:0:17242:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789403393.490656:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789403393.490660:0:17242:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1789403393.490678:0:17242:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789403393.490686:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403393.490697:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a245c999c0) 00000020:00000080:1.0:1789403393.490708:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789403393.490714:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789403393.490776:0:17242:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789403393.490782:0:17242:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789403393.490787:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761d1c 00010000:00080000:1.0:1789403393.490813:0:17242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1436b1000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403393.491349:0:17242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1789403393.492173:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050778368 00000100:00100000:2.0:1789403393.492185:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050778368 00000100:00100000:2.0:1789403393.492224:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403393.492231:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050778368:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789403393.492265:0:17229:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789403393.497099:0:17242:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789403393.497333:0:17242:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789403393.503535:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403393.504090:0:17242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789403393.520848:0:17242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789403393.521941:0:17248:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789403393.521954:0:17248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789403393.523495:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403393.523508:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789403393.523984:0:17242:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789403393.524009:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b761d23 00000100:00080000:0.0:1789403393.524020:0:17242:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403393.524031:0:17242:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a1436b1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403393.524066:0:17242:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418ce00 x1876325050778496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403393.524132:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050778496:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789403393.524195:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050778496 offset 0 length 520: 4 00000100:00080000:0.0:1789403393.524257:0:17242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789403393.524328:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403393.524333:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403393.524335:0:17242:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789403393.524338:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789403393.524341:0:17242:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789403393.524342:0:17242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403393.524352:0:17242:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403393.524354:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789403393.524357:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403393.524358:0:17242:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789403393.524361:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789403393.524365:0:17242:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789403393.524368:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403393.524370:0:17242:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789403393.524372:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789403393.524376:0:17242:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1789403393.524417:0:17242:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789403393.524421:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403393.524433:0:17242:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a14264b380) 00000020:00000080:0.0:1789403393.524445:0:17242:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789403393.524450:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789403393.524515:0:17242:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789403393.524521:0:17242:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789403393.524526:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b761d31 00010000:00080000:0.0:1789403393.525711:0:17242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a26d2d2000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403393.525948:0:17242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789403393.526018:0:17242:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789403393.526034:0:17242:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1789403393.527871:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050778368:12345-0@lo:38:llog_process_th.0 Request processed in 35631us (37398us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789403393.527899:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789403393.530093:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403393.530107:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789403393.530112:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050778368:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789403393.531186:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403393.531446:0:17242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789403393.531767:0:17242:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789403393.532086:0:17250:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789403393.532091:0:17250:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789403393.533020:0:17242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789403393.533033:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789403393.533083:0:17242:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789403393.533105:0:17242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b761d38 00000100:00080000:2.0:1789403393.533114:0:17242:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789403393.533125:0:17242:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a26d2d2000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403393.533160:0:17242:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e5f80 x1876325050778624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403393.533217:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050778624:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789403393.533276:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050778624 offset 0 length 520: 4 00000100:00080000:2.0:1789403393.533327:0:17242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789403393.533384:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403393.533414:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.533416:0:17242:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789403393.533419:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403393.533423:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.533424:0:17242:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789403393.533427:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789403393.533428:0:17242:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789403393.533431:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403393.533433:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.533434:0:17242:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789403393.533436:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403393.533438:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.533440:0:17242:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789403393.533443:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789403393.533473:0:17242:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17242:1876325050778752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403393.533527:0:17242:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403393.533568:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a24164a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789403393.533588:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050778752 00000100:00100000:2.0:1789403393.533595:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050778752 00000100:00100000:2.0:1789403393.533630:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403393.533639:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17242:x1876325050778752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403393.533745:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17242:x1876325050778752:12345-0@lo:502:llog_process_th.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403393.533752:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403393.533809:0:17242:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17242:1876325050778752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789403393.533832:0:17242:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403393.533837:0:17242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403393.533839:0:17242:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789403393.533843:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789403393.533953:0:17203:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789403393.533969:0:17203:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789403393.533983:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.533992:0:17203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403393.534000:0:17203:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a14452d000 from 1 10000000:01000000:2.0:1789403393.534002:0:17203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789403393.534027:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.534035:0:17203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.534054:0:17203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403393.534067:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050778880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403393.534094:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403393.534106:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403393.534904:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050778880 00000100:00100000:3.0:1789403393.534915:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050778880 00000100:00100000:3.0:1789403393.534974:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403393.534982:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24845cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+9:17203:x1876325050778880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403393.534995:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403393.535010:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761d3f expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.535051:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 10 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.535063:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 10 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.535072:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947e00, rc 0) 00000100:00100000:3.0:1789403393.535122:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24845cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+10:17203:x1876325050778880:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.535129:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403393.535339:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050778880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403393.535360:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.535369:0:17203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403393.536236:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779008:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789403393.536298:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403393.536330:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403393.536420:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779008 00000100:00100000:3.0:1789403393.536428:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779008 00000100:00100000:3.0:1789403393.536463:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403393.536471:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+10:17203:x1876325050779008:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789403393.536489:0:17217:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789403393.536495:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789403393.536814:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+10:17203:x1876325050779008:12345-0@lo:256:mount.lustre.0 Request processed in 343us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.536822:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403393.536915:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779008:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789403393.537497:0:17203:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403393.537519:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.537532:0:17203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403393.537540:0:17203:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a14452d000 from 1 10000000:01000000:0.0:1789403393.537863:0:17203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403393.537897:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.537906:0:17203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.537915:0:17203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.537934:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403393.538035:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.538096:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403393.538290:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779136 00000100:00100000:2.0:1789403393.538297:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779136 00000100:00100000:3.0:1789403393.538485:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403393.538494:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+10:17203:x1876325050779136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403393.538507:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403393.538521:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761d4d expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.538544:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 11 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.538676:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 11 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.538685:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946800, rc 0) 00000100:00100000:3.0:1789403393.538771:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17203:x1876325050779136:12345-0@lo:101:mount.lustre.0 Request processed in 277us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.538778:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403393.538834:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403393.538849:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.538858:0:17203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.538931:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403393.539049:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.539105:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243504240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403393.539140:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779264 00000100:00100000:3.0:1789403393.539145:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779264 00000100:00100000:3.0:1789403393.539206:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403393.539213:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17203:x1876325050779264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403393.539346:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17203:x1876325050779264:12345-0@lo:501:mount.lustre.0 Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.539354:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403393.539418:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403393.539450:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403393.539492:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.540325:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2615c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.540384:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779392 00000100:00100000:0.0:1789403393.540405:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779392 00000100:00100000:0.0:1789403393.540436:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403393.540446:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17203:x1876325050779392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403393.540665:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17203:x1876325050779392:12345-0@lo:503:mount.lustre.0 Request processed in 220us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403393.540679:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403393.540795:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403393.541479:0:17252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17252:1876325050779520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403393.541521:0:17252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.545765:0:17252:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.545896:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779520 00000100:00100000:0.0:1789403393.545905:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779520 00000100:00100000:0.0:1789403393.546029:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789403393.546040:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17252:x1876325050779520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403393.546927:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17252:x1876325050779520:12345-0@lo:502:llog_process_th.0 Request processed in 886us (5401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403393.546937:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403393.549675:0:17252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17252:1876325050779520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403393.549723:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403393.549735:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.549738:0:17252:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789403393.549745:0:17252:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a14452d000 00000020:00000080:1.0:1789403393.549748:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403393.549766:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.549770:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.549771:0:17252:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789403393.549774:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403393.549777:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.549778:0:17252:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789403393.549781:0:17252:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a14452d000 00000020:00000080:1.0:1789403393.549783:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403393.549888:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.549892:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.549894:0:17252:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789403393.549896:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403393.549898:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.549900:0:17252:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789403393.549903:0:17252:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a14452d000 00000020:00000080:1.0:1789403393.549905:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403393.553049:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.553061:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.553064:0:17252:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789403393.553067:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403393.553077:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.553078:0:17252:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789403393.553083:0:17252:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a14452d000 00000020:00000080:1.0:1789403393.553086:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789403393.553166:0:17252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17252:1876325050779648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403393.553249:0:17252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403393.553296:0:17252:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.553382:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779648 00000100:00100000:0.0:1789403393.553414:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779648 00000100:00100000:0.0:1789403393.553463:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789403393.553472:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17252:x1876325050779648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403393.553592:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17252:x1876325050779648:12345-0@lo:502:llog_process_th.0 Request processed in 121us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403393.553600:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403393.553916:0:17252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17252:1876325050779648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403393.553942:0:17252:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403393.553958:0:17252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403393.553960:0:17252:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789403393.553963:0:17252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789403393.554165:0:17203:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789403393.554186:0:17203:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789403393.554208:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.554220:0:17203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403393.554276:0:17203:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789403393.554279:0:17203:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a14452d000 10000000:01000000:0.0:1789403393.554282:0:17203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a14452d000 10000000:01000000:0.0:1789403393.554285:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789403393.554297:0:17203:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a14452d000 from 1 10000000:01000000:0.0:1789403393.554300:0:17203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789403393.554325:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.554334:0:17203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.554343:0:17203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.554361:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403393.554418:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.560498:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2617c5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403393.560739:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779776 00000100:00100000:3.0:1789403393.560748:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779776 00000100:00100000:3.0:1789403393.560832:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403393.560842:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17203:x1876325050779776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403393.560858:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403393.560887:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947200/0x5fb08b1e5b761d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761d5b expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.560918:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947200/0x5fb08b1e5b761d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d5b expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.560930:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947200/0x5fb08b1e5b761d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d5b expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.560941:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947200, rc 0) 00000100:00100000:3.0:1789403393.561009:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050779776:12345-0@lo:101:mount.lustre.0 Request processed in 169us (6590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.561016:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403393.564514:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403393.564540:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.565015:0:17203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.565097:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403393.565148:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.565184:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2617c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403393.568673:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050779904 00000100:00100000:1.0:1789403393.568686:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050779904 00000100:00100000:1.0:1789403393.568750:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403393.568759:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050779904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403393.568923:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050779904:12345-0@lo:501:mount.lustre.0 Request processed in 165us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403393.568929:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789403393.569087:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050779904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403393.569134:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050780032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403393.569175:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.569216:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2617c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403393.569650:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780032 00000100:00100000:1.0:1789403393.569656:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780032 00000100:00100000:1.0:1789403393.569690:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403393.569698:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050780032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403393.569785:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050780032:12345-0@lo:503:mount.lustre.0 Request processed in 87us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403393.569791:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789403393.569857:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050780032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403393.570427:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17256:1876325050780160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403393.570471:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403393.570496:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403393.570626:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780160 00000100:00100000:1.0:1789403393.570636:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780160 00000100:00100000:1.0:1789403393.570668:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789403393.570675:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17256:x1876325050780160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403393.570755:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17256:x1876325050780160:12345-0@lo:502:llog_process_th.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403393.570762:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403393.570839:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17256:1876325050780160:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789403393.570891:0:17256:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789403393.570906:0:17256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90a27dbd3380) 00000020:00000080:3.0:1789403393.570924:0:17256:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789403393.571024:0:17256:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a14452d000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789403393.571028:0:17256:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a14452d000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789403393.571030:0:17256:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a14452d000 4 00010000:00080000:3.0:1789403393.571058:0:17256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a141b02000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403393.572613:0:17256:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789403393.572796:0:17256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789403393.572828:0:17256:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403393.572838:0:17256:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb08b1e5b761d70 00000100:00080000:3.0:1789403393.572847:0:17256:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403393.572860:0:17256:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a141b02000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403393.572889:0:17256:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b4a80 x1876325050780288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403393.572916:0:17256:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789403393.573041:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050780288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403393.573104:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.573692:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17256:1876325050780416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403393.573730:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.573751:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a242dccc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403393.573883:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780288 00000100:00100000:1.0:1789403393.573890:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780288 00000100:00100000:1.0:1789403393.573944:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403393.574014:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050780288:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789403393.574069:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050780288:12345-0@lo:38:llog_process_th.0 Request processed in 56us (965us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789403393.574075:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403393.574125:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403393.574132:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b02000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403393.574136:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789403393.574139:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050780288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789403393.574203:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780416 00000100:00100000:1.0:1789403393.574208:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780416 00000100:00100000:1.0:1789403393.574270:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789403393.574277:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17256:x1876325050780416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403393.574514:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17256:x1876325050780416:12345-0@lo:502:llog_process_th.0 Request processed in 237us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403393.574522:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789403393.574670:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17256:1876325050780416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403393.574715:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17256:1876325050780544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403393.574747:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403393.574777:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245cadcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.574813:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780544 00000100:00100000:0.0:1789403393.574817:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780544 00000100:00100000:0.0:1789403393.574838:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403393.574843:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17256:x1876325050780544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403393.574909:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17256:x1876325050780544:12345-0@lo:502:llog_process_th.0 Request processed in 65us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403393.574915:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403393.575028:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17256:1876325050780544:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789403393.575046:0:17256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789403393.575170:0:17203:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789403393.575192:0:17203:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403393.575212:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.575224:0:17203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789403393.575289:0:17203:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789403393.575290:0:17203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789403393.575292:0:17203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403393.575293:0:17203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403393.575295:0:17203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403393.575296:0:17203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403393.575297:0:17203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403393.575299:0:17203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789403393.575301:0:17203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403393.575302:0:17203:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403393.575306:0:17203:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789403393.575308:0:17203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789403393.575309:0:17203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789403393.575310:0:17203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403393.575311:0:17203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403393.575312:0:17203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403393.575313:0:17203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403393.575314:0:17203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403393.575315:0:17203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789403393.575316:0:17203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403393.575317:0:17203:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403393.575331:0:17203:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789403393.575341:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050780672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789403393.575368:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.575382:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a242dccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.575420:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780672 00000100:00100000:0.0:1789403393.575424:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780672 00000100:00100000:0.0:1789403393.575445:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789403393.575450:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050780672:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789403393.575471:0:17217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789403393.575485:0:17217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789403393.582144:0:17217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789403393.582200:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789403393.582765:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17203:x1876325050780672:12345-0@lo:253:mount.lustre.0 Request processed in 7309us (7390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403393.582786:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1789403393.582916:0:17240:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789403393.582922:0:17240:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789403393.583010:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.583026:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 11 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.583035:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.583071:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 11 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403393.583085:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 11 pid: 17218 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403393.583099:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050780800:0@lo:104: 00000100:00100000:0.0:1789403393.583139:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403393.583215:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403393.583262:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17203:1876325050780672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789403393.583275:0:17203:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789403393.583278:0:17203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789403393.583280:0:17203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789403393.583282:0:17203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403393.583283:0:17203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403393.583284:0:17203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403393.583286:0:17203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403393.583287:0:17203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403393.583289:0:17203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789403393.583290:0:17203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403393.583291:0:17203:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789403393.583304:0:17203:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789403393.585075:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780800 00000100:00100000:3.0:1789403393.585089:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780800 00000100:00100000:3.0:1789403393.586674:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403393.586690:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050780800:12345-0@lo:104: 00010000:00010000:3.0:1789403393.586711:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.586806:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789403393.586812:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050780800:12345-0@lo:104: Request processed in 128us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403393.586819:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789403393.587692:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403393.587700:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.587710:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403393.587714:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.587722:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403393.587729:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403393.587734:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403393.587771:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.587778:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403393.587798:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.587804:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d46 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.587817:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.587818:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403393.587820:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403393.587850:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403393.587870:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050780928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403393.587920:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403393.588622:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050780928 00000100:00100000:2.0:1789403393.588630:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050780928 00010000:00010000:2.0:1789403393.588657:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 12 pid: 17218 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403393.588686:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403393.588694:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:3628:x1876325050780928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403393.588706:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403393.588711:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 12 pid: 17218 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588722:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 12 pid: 17218 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588741:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588749:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789403393.588765:0:17209:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005843417s 00010000:00010000:2.0:1789403393.588769:0:17209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588776:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588782:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588800:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588805:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403393.588809:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588817:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588825:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403393.588834:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403393.588877:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:3628:x1876325050780928:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403393.588884:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403393.588923:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050780928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403393.589287:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947e00/0x5fb08b1e5b761d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761d3f expref: 11 pid: 17218 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403393.589299:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050780800:0@lo:104: 00010000:00010000:3.0:1789403393.589314:0:17240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.589322:0:17240:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.589329:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403393.589346:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761d77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789403393.598661:0:17203:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789403393.601131:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789403393.601212:0:17263:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789403393.601216:0:17263:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789403393.601679:0:17264:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789403393.602117:0:17264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403393.604203:0:17264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789403393.604285:0:17264:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1789403393.605258:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1789403393.605699:0:17265:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90a1442b6a00 x1876325050781056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403393.605712:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000040:01000000:2.0:1789403393.606208:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789403393.606253:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789403393.606808:0:17203:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789403393.606816:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789403393.606854:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403393.608133:0:17203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789403393.610752:0:17203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789403393.610814:0:17203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789403393.612263:0:17203:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1789403393.615181:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789403393.617089:0:17203:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789403393.617125:0:17203:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb21c1993988 00100000:10000000:0.0:1789403393.617134:0:17203:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789403393.617841:0:17203:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789403393.617856:0:17203:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789403393.617967:0:17203:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789403393.617988:0:17203:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789403393.618649:0:17203:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403393.618827:0:17203:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403394.291679:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403394.616428:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789403394.616496:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 10000000:01000000:3.0:1789403394.869118:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789403394.869127:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a14452d000 from 7 10000000:01000000:3.0:1789403394.869132:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403394.869178:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403394.869190:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403394.869219:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403394.869253:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050781184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403394.869327:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403394.869377:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a537240 going to sleep for 11 seconds 00000100:00100000:0.0:1789403394.869523:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781184 00000100:00100000:0.0:1789403394.869532:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781184 00000100:00100000:0.0:1789403394.869592:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403394.869603:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+11:17221:x1876325050781184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403394.869615:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403394.869629:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761d7e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403394.869653:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 12 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403394.869665:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 12 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403394.869673:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8a00, rc 0) 00000100:00100000:0.0:1789403394.869717:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17221:x1876325050781184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403394.869724:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403394.869769:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050781184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403394.869783:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403394.869792:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403394.869842:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050781312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789403394.869876:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403394.869895:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a276a59c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403394.870592:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781312 00000100:00100000:2.0:1789403394.870600:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781312 00000100:00100000:2.0:1789403394.870643:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789403394.870651:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17221:x1876325050781312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789403394.870668:0:17217:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789403394.870685:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789403394.870688:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789403394.870780:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17221:x1876325050781312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403394.870787:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403394.870895:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050781312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789403394.870953:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403394.870961:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403394.870971:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403395.313545:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403395.633505:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000040:00080000:1.0:1789403395.634063:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403396.337777:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403396.657742:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:1.0:1789403397.363320:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403397.687500:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000001:02000400:0.0:1789403397.882707:0:17509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789403398.385811:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403398.708351:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000020:00000004:3.0:1789403398.751020:0:17561:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403398.751281:0:17561:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1789403398.905311:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789403398.905318:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789403398.905321:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403398.905330:0:17331:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1789403398.905335:0:17331:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789403398.905358:0:17331:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a1436b4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403398.905416:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144182d80 x1876325050781568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403398.905431:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403398.905434:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403398.905437:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403398.905440:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403398.905443:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789403398.905446:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789403398.905448:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a141b02000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403398.905453:0:17331:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a141b02000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403398.905465:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144182300 x1876325050781696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403398.905508:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050781568:0@lo:38:kworker.0 00000100:00100000:1.0:1789403398.905567:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403398.905628:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781568 00000100:00100000:1.0:1789403398.905636:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781568 00000100:00100000:1.0:1789403398.905668:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403398.905676:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050781568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789403398.905694:0:17230:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789403398.906096:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403398.906111:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050781440:0@lo:400:kworker.0 00000100:00100000:0.0:1789403398.906156:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403398.906216:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781440 00000100:00100000:0.0:1789403398.906221:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781440 00000100:00100000:0.0:1789403398.906254:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403398.906262:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:3627:x1876325050781440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403398.906314:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:3627:x1876325050781440:12345-0@lo:400:kworker.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403398.906323:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403398.906382:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050781440:0@lo:400:kworker.0 00000100:00100000:0.0:1789403398.906442:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050781696:0@lo:38:kworker.0 00000100:00100000:0.0:1789403398.906469:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403398.907483:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781696 00000100:00100000:3.0:1789403398.907492:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781696 00000100:00100000:3.0:1789403398.907529:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403398.907535:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050781696:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789403398.907559:0:17226:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1789403398.907593:0:17226:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb08b1e5b761d8c 00000004:00100000:3.0:1789403398.907607:0:17226:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789403398.907748:0:17226:0:(import.c:65:import_set_state_nolock()) ffff90a281b10000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403398.907807:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876325050781696:12345-0@lo:38:kworker.0 Request processed in 270us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403398.907813:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403398.907937:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144182300 x1876325050781696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789403398.907951:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789403398.907958:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789403398.907962:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789403398.907964:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b02000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789403398.907969:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050781696:0@lo:38:kworker.0 00000100:00100000:1.0:1789403398.919269:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050781568:12345-0@lo:38:kworker.0 Request processed in 13583us (13693us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789403398.919283:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789403398.919293:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403398.919302:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789403398.919307:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050781568:0@lo:38:kworker.0 00010000:00010000:1.0:1789403399.410730:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789403399.611921:0:17611:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403399.612100:0:17611:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789403399.731019:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:2.0:1789403400.433635:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403400.759026:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:2.0:1789403401.457945:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403401.777697:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:0.0:1789403402.485489:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403402.801491:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:1.0:1789403403.510553:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403403.825509:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000100:00080000:1.0:1789403404.018115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789403404.018121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789403404.018125:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403404.018133:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1789403404.018138:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789403404.018148:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a1436b4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403404.018180:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144182a00 x1876325050781952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403404.018191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403404.018195:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403404.018198:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403404.018200:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789403404.018232:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403404.018248:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050781824:0@lo:400:kworker.0 00000100:00100000:1.0:1789403404.018312:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403404.018362:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050782080:0@lo:400:kworker.0 00000100:00100000:1.0:1789403404.018419:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403404.018579:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781824 00000100:00100000:1.0:1789403404.018587:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781824 00000100:00100000:1.0:1789403404.018630:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403404.018638:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:3626:x1876325050781824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403404.018701:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:3626:x1876325050781824:12345-0@lo:400:kworker.0 Request processed in 64us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403404.018710:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403404.018739:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050782080 00000100:00100000:1.0:1789403404.018743:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050782080 00000100:00100000:1.0:1789403404.018768:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403404.018774:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050782080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403404.018808:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050782080:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403404.018814:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789403404.018849:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144183480 x1876325050782080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403404.018862:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050782080:0@lo:400:kworker.0 00000100:00100000:1.0:1789403404.018887:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050781824:0@lo:400:kworker.0 00000100:00100000:3.0:1789403404.019104:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403393/real 1789403393] req@ffff90a1443e5f80 x1876325050778624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403404.019123:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a1443e5f80 x1876325050778624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403404.019133:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403393/real 1789403393] req@ffff90a14418ce00 x1876325050778496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403404.019155:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a14418ce00 x1876325050778496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403404.019180:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050781952:0@lo:38:kworker.0 00000100:00100000:3.0:1789403404.019211:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789403404.019239:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403404.019250:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789403404.019253:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050778624:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789403404.019258:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403404.019261:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789403404.019263:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050778496:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789403404.019405:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781952 00000100:00100000:1.0:1789403404.019411:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781952 00000100:00100000:1.0:1789403404.019432:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403404.019438:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050781952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789403404.019961:0:17229:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789403404.021856:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403404.021864:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789403404.021867:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403404.021873:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1789403404.021879:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789403404.021888:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a1436b1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403404.021924:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418fb80 x1876325050782208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403404.021961:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403404.021965:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789403404.021966:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403404.021970:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1789403404.021972:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789403404.021990:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a26d2d2000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403404.022003:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418c700 x1876325050782336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403404.024332:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050782208:0@lo:8:kworker.0 00000400:00000100:3.0:1789403404.025266:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050782208 offset 0 length 520: 4 00000100:00100000:3.0:1789403404.025310:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050782336:0@lo:8:kworker.0 00000400:00000100:3.0:1789403404.025337:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050782336 offset 0 length 520: 4 00000100:00100000:1.0:1789403404.048136:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050781952:12345-0@lo:38:kworker.0 Request processed in 28689us (28916us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789403404.048151:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789403404.048211:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403404.048217:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789403404.048221:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050781952:0@lo:38:kworker.0 00010000:00010000:0.0:1789403404.529584:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403404.849784:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:3.0:1789403405.557702:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403405.874080:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789403405.874451:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000020:01000004:3.0:1789403406.205693:0:17956:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789403406.205697:0:17956:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789403406.205698:0:17956:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789403406.205808:0:17956:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a281b17800 00000020:01000004:3.0:1789403406.205822:0:17956:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789403406.205833:0:17956:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789403406.205845:0:17956:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90a27dbd4d40) 00000020:00000080:3.0:1789403406.206804:0:17956:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789403406.286114:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.286481:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789403406.287890:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.293479:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.294001:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.294267:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.294479:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.294988:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.295297:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.295754:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.296263:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.296483:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.297003:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.297332:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.297833:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.298288:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.298506:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.299062:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.299356:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.299756:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789403406.300313:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.300858:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789403406.301297:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789403406.301872:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.302879:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.303339:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789403406.304632:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.309725:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.310417:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789403406.317508:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.318282:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789403406.318874:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789403406.319430:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.319963:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789403406.323129:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789403406.323721:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789403406.324335:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789403406.324710:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789403406.325277:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789403406.325671:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789403406.326133:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789403406.326451:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789403406.326865:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789403406.327362:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789403406.327744:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789403406.328099:0:17956:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1789403406.330848:0:17956:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789403406.331251:0:17956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789403406.331265:0:17956:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789403406.331278:0:17956:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b761d9a 00000020:01000004:1.0:1789403406.331285:0:17956:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789403406.331303:0:17956:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789403406.331307:0:17956:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789403406.331313:0:17956:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789403406.331340:0:17956:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789403406.331345:0:17956:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789403406.339716:0:17956:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789403406.339756:0:17956:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789403406.339762:0:17956:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789403406.339764:0:17956:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789403406.339765:0:17956:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403406.339843:0:17956:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403406.339844:0:17956:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403406.339846:0:17956:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403406.339847:0:17956:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403406.339849:0:17956:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403406.339850:0:17956:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789403406.340072:0:17956:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789403406.340076:0:17956:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789403406.340077:0:17956:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789403406.340084:0:17956:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403406.340085:0:17956:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403406.340086:0:17956:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403406.340087:0:17956:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403406.340088:0:17956:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403406.340089:0:17956:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403406.340090:0:17956:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789403406.340114:0:17956:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789403406.340134:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789403406.340274:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.340380:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a242cd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.340626:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050782464 00000100:00100000:0.0:1789403406.340635:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050782464 00000100:00100000:0.0:1789403406.340722:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789403406.340732:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17956:x1876325050782464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789403406.340760:0:17219:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789403406.340764:0:17219:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789403406.340778:0:17219:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789403406.341505:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17956:x1876325050782464:12345-0@lo:253:mount.lustre.0 Request processed in 772us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.341515:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403406.341612:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789403406.341627:0:17956:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789403406.341630:0:17956:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789403406.341631:0:17956:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789403406.341632:0:17956:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403406.341633:0:17956:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403406.341634:0:17956:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403406.341635:0:17956:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403406.341636:0:17956:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789403406.341637:0:17956:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403406.341638:0:17956:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789403406.341654:0:17956:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a281b17800 from lustre-MDT0001 10000000:01000000:2.0:1789403406.341680:0:17956:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789403406.341683:0:17956:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789403406.341690:0:17956:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a142648000 local copy 00010000:00010000:2.0:1789403406.341700:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403406.341801:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403406.341831:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.343278:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.343341:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050782592 00000100:00100000:1.0:1789403406.343349:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050782592 00000100:00100000:1.0:1789403406.343414:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403406.343424:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17956:x1876325050782592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403406.343526:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17956:x1876325050782592:12345-0@lo:501:mount.lustre.0 Request processed in 103us (1693us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403406.343541:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403406.343674:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782592:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789403406.343704:0:17956:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789403406.343725:0:17956:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789403406.343732:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.343743:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403406.343781:0:17956:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a281b17800 10000000:01000000:2.0:1789403406.343787:0:17956:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789403406.343792:0:17956:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a142648000 10000000:01000000:2.0:1789403406.343794:0:17956:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789403406.343798:0:17956:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a142648000 from 1 10000000:01000000:2.0:1789403406.343801:0:17956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789403406.343829:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.343837:0:17956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.343846:0:17956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403406.343873:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403406.343913:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.343947:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.344098:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050782720 00000100:00100000:1.0:1789403406.344103:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050782720 00000100:00100000:1.0:1789403406.344124:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789403406.344130:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+12:17956:x1876325050782720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403406.344139:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403406.344165:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b761da8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761da1 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.344185:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b761da8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761da1 expref: 13 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.344196:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b761da8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761da1 expref: 13 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.344216:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05000, rc 0) 00000100:00100000:1.0:1789403406.344256:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+13:17956:x1876325050782720:12345-0@lo:101:mount.lustre.0 Request processed in 125us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.344262:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403406.344524:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403406.344546:0:17956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.344562:0:17956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403406.344580:0:17956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789403406.344594:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.344600:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403406.344607:0:17956:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a281b17800 10000000:01000000:2.0:1789403406.344611:0:17956:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789403406.344615:0:17956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a281b17800 from 1 10000000:01000000:2.0:1789403406.344617:0:17956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789403406.344633:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.344641:0:17956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.344648:0:17956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403406.344662:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403406.344690:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.344708:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.346216:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050782848 00000100:00100000:1.0:1789403406.346229:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050782848 00000100:00100000:1.0:1789403406.346274:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789403406.346282:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+13:17956:x1876325050782848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403406.346297:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403406.346313:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04200/0x5fb08b1e5b761db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761daf expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.346335:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04200/0x5fb08b1e5b761db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761daf expref: 14 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.346345:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04200/0x5fb08b1e5b761db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761daf expref: 14 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.346352:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04200, rc 0) 00000100:00100000:1.0:1789403406.346438:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+14:17956:x1876325050782848:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.346445:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403406.346683:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403406.346701:0:17956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.346969:0:17956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403406.346998:0:17956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789403406.347013:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.347020:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403406.347027:0:17956:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789403406.347033:0:17956:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789403406.347038:0:17956:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a281b17800 10000000:01000000:2.0:1789403406.347040:0:17956:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789403406.347043:0:17956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789403406.347046:0:17956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789403406.347069:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.347076:0:17956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.347083:0:17956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403406.347100:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403406.347134:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.347185:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.347318:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050782976 00000100:00100000:0.0:1789403406.347324:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050782976 00000100:00100000:0.0:1789403406.347363:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789403406.347371:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+14:17956:x1876325050782976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403406.347458:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403406.347469:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e9e00/0x5fb08b1e5b761dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761dbd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.347487:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e9e00/0x5fb08b1e5b761dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761dbd expref: 15 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.347502:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e9e00/0x5fb08b1e5b761dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761dbd expref: 15 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.347510:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9e00, rc 0) 00000100:00100000:0.0:1789403406.347548:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050782976:12345-0@lo:101:mount.lustre.0 Request processed in 178us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.347554:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403406.347650:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050782976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403406.347662:0:17956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403406.347670:0:17956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403406.354690:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789403406.359092:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403406.364048:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789403406.364103:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789403406.364120:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789403406.364135:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789403406.364159:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789403406.364176:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789403406.364190:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789403406.364204:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789403406.364216:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789403406.364230:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789403406.364243:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789403406.364256:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789403406.364268:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789403406.364281:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789403406.364294:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789403406.364306:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789403406.364318:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789403406.364331:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789403406.364345:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789403406.364357:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789403406.364372:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789403406.364690:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789403406.364716:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789403406.364744:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789403406.364750:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789403406.364868:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403406.364931:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.365016:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.365104:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783104 00000100:00100000:2.0:1789403406.365112:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783104 00000100:00100000:2.0:1789403406.365214:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403406.365224:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403406.365367:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783104:12345-0@lo:501:mount.lustre.0 Request processed in 144us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403406.365374:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789403406.365504:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403406.365548:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403406.365600:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.365981:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.366042:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783232 00000100:00100000:0.0:1789403406.366048:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783232 00000100:00100000:0.0:1789403406.366081:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789403406.366088:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403406.366783:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783232:12345-0@lo:503:mount.lustre.0 Request processed in 693us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.366792:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403406.367039:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783232:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789403406.367447:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403406.367643:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403406.367697:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.367726:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.367787:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783360 00000100:00100000:2.0:1789403406.367793:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783360 00000100:00100000:2.0:1789403406.367831:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403406.367840:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403406.368442:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783360:12345-0@lo:502:mount.lustre.0 Request processed in 602us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403406.368451:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403406.368805:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403406.369132:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789403406.369176:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789403406.369193:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789403406.369207:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789403406.369221:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789403406.369236:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789403406.369250:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789403406.369264:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789403406.369279:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789403406.369295:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789403406.369311:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789403406.369325:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789403406.369339:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789403406.369353:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789403406.369368:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789403406.369382:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789403406.369418:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789403406.369433:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789403406.369447:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789403406.369460:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789403406.369474:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789403406.369640:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789403406.369657:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789403406.369673:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789403406.369689:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789403406.369701:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789403406.369712:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789403406.369724:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789403406.369737:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789403406.369750:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789403406.369762:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789403406.369776:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789403406.369790:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789403406.369804:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789403406.369819:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789403406.369834:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789403406.369849:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789403406.371680:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789403406.371701:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789403406.371717:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789403406.371731:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789403406.371746:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789403406.371762:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789403406.371776:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789403406.371823:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403406.372182:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.372271:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.372356:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783488 00000100:00100000:2.0:1789403406.372364:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783488 00000100:00100000:3.0:1789403406.372785:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789403406.372796:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403406.373050:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050783488:12345-0@lo:502:mount.lustre.0 Request processed in 255us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.373071:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789403406.373155:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050783488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403406.373222:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789403406.373234:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789403406.374213:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403406.374225:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403406.374227:0:17960:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789403406.374239:0:17960:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789403406.374241:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403406.374256:0:17960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90a1425d3380) 00000020:00000080:2.0:1789403406.374278:0:17960:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789403406.374284:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789403406.374380:0:17960:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789403406.374480:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b761dd2 00000020:00000080:2.0:1789403406.374832:0:17960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789403406.374837:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403406.374842:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403406.374844:0:17960:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789403406.374848:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403406.374925:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403406.374927:0:17960:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789403406.374933:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403406.374951:0:17960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90a27e008000) 00000020:00000080:2.0:1789403406.374966:0:17960:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789403406.374972:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789403406.374974:0:17960:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789403406.374976:0:17960:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789403406.374982:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789403406.375046:0:17960:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a281b17800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789403406.375057:0:17960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90a27e0099c0) 00000020:00000080:2.0:1789403406.375068:0:17960:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789403406.375120:0:17960:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789403406.375126:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b761de7 00000020:00000080:2.0:1789403406.375229:0:17960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789403406.375236:0:17960:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789403406.375240:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5fb08b1e5b761dee 00080000:01000000:2.0:1789403406.375246:0:17960:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789403406.375249:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b761df5 00010000:00010000:2.0:1789403406.440029:0:17960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789403406.441634:0:17960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789403406.442465:0:17960:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789403406.444868:0:17960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789403406.444882:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403406.444888:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.444890:0:17960:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789403406.444894:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403406.444900:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.444902:0:17960:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789403406.444905:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403406.444910:0:17960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:3.0:1789403406.444936:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403406.444950:0:17960:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90a27dbd0000) 00000020:00000080:3.0:1789403406.444971:0:17960:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789403406.444977:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403406.445038:0:17960:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789403406.445045:0:17960:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789403406.445051:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b761e03 00010000:00080000:3.0:1789403406.445081:0:17960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a26d2d7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403406.446907:0:17960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789403406.450683:0:17960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789403406.450699:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789403406.450753:0:17960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789403406.450774:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b761e0a 00000100:00080000:0.0:1789403406.450783:0:17960:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403406.450796:0:17960:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a26d2d7800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403406.450829:0:17960:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418f800 x1876325050783616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403406.450848:0:17960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789403406.450917:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403406.450921:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.450922:0:17960:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789403406.450925:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789403406.450928:0:17960:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789403406.450930:0:17960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403406.450931:0:17960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403406.450933:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789403406.450935:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.450937:0:17960:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789403406.450946:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403406.450950:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.450952:0:17960:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789403406.450956:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789403406.450989:0:17960:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789403406.451002:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403406.451006:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.451007:0:17960:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789403406.451010:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789403406.451012:0:17960:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789403406.451013:0:17960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403406.451014:0:17960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789403406.451016:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789403406.451019:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.451020:0:17960:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789403406.451022:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789403406.451025:0:17960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789403406.451028:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.451030:0:17960:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789403406.451033:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789403406.451036:0:17960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:0.0:1789403406.451056:0:17960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789403406.451059:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403406.451071:0:17960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90a281873380) 00000020:00000080:0.0:1789403406.451083:0:17960:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789403406.451088:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789403406.451138:0:17960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789403406.451153:0:17960:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789403406.451159:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b761e18 00010000:00080000:0.0:1789403406.451186:0:17960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a26d2d3000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403406.451447:0:17960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1789403406.451899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789403406.451904:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789403406.451907:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403406.451912:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1789403406.451917:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789403406.451923:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a1436b4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403406.451948:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e6d80 x1876325050783744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789403406.451961:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403406.451964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403406.451967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403406.451970:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403406.452134:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050783872:0@lo:400:kworker.0 00000100:00100000:2.0:1789403406.452207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.452502:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050783616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789403406.452550:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.452582:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050783744:0@lo:38:kworker.0 00000100:00100000:3.0:1789403406.452601:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.452630:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783616 00000100:00100000:3.0:1789403406.452637:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783616 00000100:00100000:3.0:1789403406.452658:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783744 00000100:00100000:3.0:1789403406.452660:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783744 00000100:00100000:3.0:1789403406.452671:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403406.452677:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050783616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789403406.452710:0:17229:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:3.0:1789403406.452752:0:17229:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b761e1f 00000004:00100000:3.0:1789403406.452764:0:17229:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789403406.452769:0:17229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789403406.453111:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050783872 00000100:00100000:0.0:1789403406.453122:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050783872 00000100:00100000:0.0:1789403406.453215:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403406.453224:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403406.453277:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050783872:12345-0@lo:400:kworker.0 Request processed in 55us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.453283:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:01000000:3.0:1789403406.458915:0:17960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789403406.460953:0:17960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00010000:00080000:0.0:1789403406.461359:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a1443e4380 x1876325050783872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403406.461376:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050783872:0@lo:400:kworker.0 00000100:00080000:3.0:1789403406.463979:0:17229:0:(import.c:65:import_set_state_nolock()) ffff90a141a3c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403406.464085:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050783616:12345-0@lo:38:llog_process_th.0 Request processed in 11405us (11532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.464096:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403406.464124:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403406.464130:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050783744:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789403406.464186:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050783744:12345-0@lo:38:kworker.0 Request processed in 54us (11582us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789403406.464192:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403406.464617:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403406.464628:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789403406.464637:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789403406.464643:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789403406.464646:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403406.464668:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050783616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789403406.464699:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403406.464704:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403406.464708:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789403406.464718:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050783744:0@lo:38:kworker.0 00000100:00100000:0.0:1789403406.464756:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050784000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403406.464801:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.464876:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050784000 00000100:00100000:2.0:1789403406.464882:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050784000 00000100:00100000:2.0:1789403406.464921:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403406.464929:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1876325050784000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403406.464954:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789403406.465003:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1876325050784000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403406.465010:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403406.465110:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050784000:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789403406.465115:0:17960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403406.465516:0:17960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789403406.465676:0:17960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1789403406.467190:0:17965:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789403406.467197:0:17965:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789403406.469822:0:17960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403406.469837:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789403406.470112:0:17960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789403406.470135:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b761e26 00000100:00080000:3.0:1789403406.470157:0:17960:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403406.470169:0:17960:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a26d2d3000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403406.470204:0:17960:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b4700 x1876325050784128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403406.470229:0:17960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789403406.471516:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403406.471539:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.471542:0:17960:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789403406.471546:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789403406.471549:0:17960:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789403406.471551:0:17960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789403406.471552:0:17960:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789403406.471554:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789403406.471556:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.471558:0:17960:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789403406.471560:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789403406.471564:0:17960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789403406.471567:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.471568:0:17960:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789403406.471571:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403406.471575:0:17960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:3.0:1789403406.471597:0:17960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789403406.471600:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403406.471612:0:17960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90a27dbd19c0) 00000020:00000080:3.0:1789403406.471629:0:17960:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789403406.471634:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403406.471698:0:17960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789403406.471704:0:17960:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789403406.471709:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b761e34 00010000:00080000:3.0:1789403406.471735:0:17960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a141b05800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403406.471956:0:17960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789403406.472021:0:17960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789403406.472035:0:17960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1789403406.472309:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050784128:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789403406.472359:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050784128 offset 0 length 520: 4 00000040:00080000:3.0:1789403406.476247:0:17960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403406.476642:0:17960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789403406.476772:0:17960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:0.0:1789403406.477245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403406.477251:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403406.477254:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403406.477257:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789403406.477515:0:17967:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789403406.477520:0:17967:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789403406.479264:0:17960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403406.479276:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789403406.479326:0:17960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789403406.479350:0:17960:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b761e3b 00000100:00080000:3.0:1789403406.479359:0:17960:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403406.479370:0:17960:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a141b05800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403406.479640:0:17960:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b7100 x1876325050784256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403406.479694:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050784256:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789403406.479746:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050784256 offset 0 length 520: 4 00000100:00080000:3.0:1789403406.479797:0:17960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789403406.479860:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403406.479865:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.479867:0:17960:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789403406.479871:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403406.479874:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.479876:0:17960:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403406.479879:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403406.479881:0:17960:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789403406.479883:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403406.479885:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.479886:0:17960:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789403406.479888:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403406.479890:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.479892:0:17960:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789403406.479895:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789403406.479921:0:17960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403406.479925:0:17960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403406.479926:0:17960:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789403406.479930:0:17960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789403406.480213:0:17956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789403406.480241:0:17956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789403406.480262:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.480272:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403406.480293:0:17956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b17800 from 1 10000000:01000000:0.0:1789403406.480296:0:17956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403406.480319:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.480327:0:17956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.480337:0:17956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403406.480352:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403406.480415:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.480434:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605900 going to sleep for 11 seconds 00000100:00080000:0.0:1789403406.480452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403406.480456:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403406.480458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403406.480461:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789403406.480694:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050784384 00000100:00100000:3.0:1789403406.480702:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050784384 00000100:00100000:3.0:1789403406.480741:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403406.480750:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+15:17956:x1876325050784384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403406.480763:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403406.480781:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761e42 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.480802:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 16 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.480812:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 16 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.480819:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947000, rc 0) 00000100:00100000:1.0:1789403406.481016:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403406.481031:0:17956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.481046:0:17956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.481619:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17956:x1876325050784384:12345-0@lo:101:mount.lustre.0 Request processed in 867us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.481627:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403406.481773:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784512:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789403406.481813:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403406.481846:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a250707900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.481957:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050784512 00000100:00100000:0.0:1789403406.481963:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050784512 00000100:00100000:0.0:1789403406.481994:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403406.482002:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17956:x1876325050784512:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789403406.482018:0:17219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789403406.482035:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789403406.482038:0:17219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789403406.482107:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17956:x1876325050784512:12345-0@lo:256:mount.lustre.0 Request processed in 105us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.482119:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789403406.482258:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784512:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789403406.483786:0:17956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403406.483806:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.483820:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403406.483946:0:17956:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b17800 from 1 10000000:01000000:3.0:1789403406.483950:0:17956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403406.483983:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.483992:0:17956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.484003:0:17956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.484023:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403406.484071:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.484110:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a246bf80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.484166:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050784640 00000100:00100000:1.0:1789403406.484172:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050784640 00000100:00100000:1.0:1789403406.484213:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789403406.484221:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17956:x1876325050784640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403406.484231:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403406.484242:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761e50 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.484259:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 17 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.484270:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 17 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.484291:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05400, rc 0) 00000100:00100000:1.0:1789403406.484323:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050784640:12345-0@lo:101:mount.lustre.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.484329:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403406.484497:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403406.484510:0:17956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.484525:0:17956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403406.484658:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403406.484688:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403406.484713:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.484732:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a246bf8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403406.484747:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050784768 00000100:00100000:3.0:1789403406.484750:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050784768 00000100:00100000:3.0:1789403406.484814:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403406.484822:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050784768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403406.484907:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050784768:12345-0@lo:501:mount.lustre.0 Request processed in 86us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.484914:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403406.485241:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403406.485266:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403406.485304:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.485327:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a246bf8240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.485369:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050784896 00000100:00100000:2.0:1789403406.485373:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050784896 00000100:00100000:3.0:1789403406.485979:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789403406.485990:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050784896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403406.486092:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050784896:12345-0@lo:503:mount.lustre.0 Request processed in 104us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.486099:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789403406.486183:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050784896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789403406.486556:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403406.486636:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403406.486677:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.487105:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605900 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.487170:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785024 00000100:00100000:1.0:1789403406.487176:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785024 00000100:00100000:1.0:1789403406.487205:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403406.487212:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050785024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403406.487309:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050785024:12345-0@lo:502:mount.lustre.0 Request processed in 97us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.487316:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403406.487409:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403406.487661:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789403406.487688:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789403406.487703:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789403406.487718:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789403406.487731:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789403406.487745:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789403406.487760:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789403406.487771:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789403406.487786:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789403406.487814:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789403406.487829:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789403406.487929:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403406.488024:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.488043:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630300 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.488303:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785152 00000100:00100000:1.0:1789403406.488309:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785152 00000100:00100000:1.0:1789403406.488331:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789403406.488338:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050785152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403406.488454:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050785152:12345-0@lo:502:mount.lustre.0 Request processed in 116us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.488462:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789403406.488649:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403406.488699:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789403406.488708:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789403406.489371:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403406.489381:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489415:0:17969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789403406.489422:0:17969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a281b17800 00000020:00000080:0.0:1789403406.489425:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403406.489432:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403406.489434:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489436:0:17969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789403406.489438:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403406.489441:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489442:0:17969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789403406.489445:0:17969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a281b17800 00000020:00000080:0.0:1789403406.489446:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403406.489498:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403406.489502:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489503:0:17969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789403406.489505:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403406.489508:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489509:0:17969:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403406.489512:0:17969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a281b17800 00000020:00000080:0.0:1789403406.489514:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403406.489603:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403406.489608:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489609:0:17969:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403406.489611:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403406.489613:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489614:0:17969:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789403406.489617:0:17969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a281b17800 00000020:00000080:0.0:1789403406.489619:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403406.489643:0:17969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403406.489646:0:17969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403406.489647:0:17969:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789403406.489650:0:17969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789403406.491633:0:17956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789403406.491671:0:17956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403406.491687:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.491701:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403406.491774:0:17956:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789403406.491777:0:17956:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a281b17800 10000000:01000000:1.0:1789403406.491780:0:17956:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a281b17800 10000000:01000000:1.0:1789403406.491784:0:17956:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403406.491788:0:17956:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a281b17800 from 1 10000000:01000000:1.0:1789403406.491791:0:17956:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403406.491822:0:17956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.491830:0:17956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.491840:0:17956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403406.491922:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789403406.492021:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403406.492055:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785280 00000100:00100000:1.0:1789403406.492061:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785280 00000100:00100000:1.0:1789403406.492095:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789403406.492103:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17956:x1876325050785280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403406.492114:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403406.492125:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b761e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761e5e expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.492157:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b761e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e5e expref: 18 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.492178:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b761e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e5e expref: 18 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.492186:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05800, rc 0) 00000100:00100000:1.0:1789403406.492213:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785280:12345-0@lo:101:mount.lustre.0 Request processed in 111us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.492219:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789403406.492254:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.492271:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403406.492283:0:17956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.492292:0:17956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403406.496367:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789403406.501277:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403406.501519:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789403406.501560:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789403406.501592:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789403406.501608:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789403406.501622:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789403406.501635:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789403406.501649:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789403406.501662:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789403406.501674:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789403406.501686:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789403406.501700:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789403406.501724:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789403406.501737:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789403406.501748:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789403406.501761:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789403406.501774:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789403406.501787:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789403406.501799:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789403406.501824:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789403406.501839:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789403406.501867:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789403406.501882:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789403406.501894:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789403406.501907:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789403406.501918:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789403406.501929:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789403406.501940:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789403406.501953:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789403406.501972:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789403406.501977:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789403406.502054:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403406.502115:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403406.502179:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785408 00000100:00100000:1.0:1789403406.502187:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785408 00000100:00100000:0.0:1789403406.504680:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281ad43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.506672:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789403406.506689:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403406.508735:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785408:12345-0@lo:501:mount.lustre.0 Request processed in 2044us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.508749:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403406.511369:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403406.511683:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403406.511754:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.511789:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.515521:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785536 00000100:00100000:0.0:1789403406.515547:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785536 00000100:00100000:0.0:1789403406.515621:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403406.515632:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403406.515789:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785536:12345-0@lo:503:mount.lustre.0 Request processed in 159us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.515797:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403406.516121:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789403406.516824:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403406.516982:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403406.517043:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.517648:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244540 going to sleep for 11 seconds 00000100:00100000:1.0:1789403406.521638:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785664 00000100:00100000:1.0:1789403406.521651:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785664 00000100:00100000:1.0:1789403406.529667:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789403406.529687:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403406.529865:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785664:12345-0@lo:502:mount.lustre.0 Request processed in 186us (12821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.529873:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789403406.530319:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403406.532010:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789403406.532060:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789403406.532075:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789403406.532087:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789403406.532100:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789403406.532113:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789403406.532127:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789403406.532152:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789403406.532169:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789403406.532184:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789403406.532199:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789403406.532226:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789403406.532241:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789403406.532255:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789403406.532269:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789403406.532300:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789403406.532317:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789403406.532332:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789403406.532346:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789403406.532361:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789403406.532375:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789403406.534643:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789403406.534694:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789403406.534713:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789403406.534729:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789403406.534745:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789403406.534761:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789403406.534775:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789403406.534791:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789403406.534806:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789403406.534821:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789403406.536188:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789403406.536225:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789403406.536237:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789403406.536250:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789403406.536262:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789403406.536275:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789403406.536288:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789403406.536303:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789403406.536316:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789403406.536329:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789403406.536343:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789403406.536357:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789403406.536372:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789403406.536414:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789403406.536431:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789403406.536445:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789403406.536476:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789403406.538284:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403406.538427:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.538469:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.538686:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785792 00000100:00100000:2.0:1789403406.538694:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785792 00000100:00100000:2.0:1789403406.538741:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789403406.538751:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403406.539612:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785792:12345-0@lo:502:mount.lustre.0 Request processed in 860us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403406.539622:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403406.539705:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403406.540670:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789403406.540703:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789403406.540739:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403406.540789:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.540827:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.541306:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050785920 00000100:00100000:2.0:1789403406.541314:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050785920 00000100:00100000:2.0:1789403406.541373:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789403406.541382:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403406.541514:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050785920:12345-0@lo:502:mount.lustre.0 Request processed in 133us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403406.541521:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403406.541642:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050785920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403406.541695:0:17956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789403406.541705:0:17956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789403406.543797:0:17975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789403406.543813:0:17975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90a281870000) 00000020:00000080:0.0:1789403406.543834:0:17975:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789403406.544224:0:17975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a281b17800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789403406.544228:0:17975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a281b17800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789403406.544231:0:17975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a281b17800 3 00010000:00080000:0.0:1789403406.544261:0:17975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a26d294000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403406.549751:0:17975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789403406.550805:0:17975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789403406.554355:0:17975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789403406.554375:0:17975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5fb08b1e5b761e73 00000100:00080000:1.0:1789403406.554411:0:17975:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403406.554424:0:17975:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a26d294000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403406.554458:0:17975:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144183800 x1876325050786048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403406.554483:0:17975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789403406.554566:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050786048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403406.554632:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403406.554698:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403406.554703:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403406.554706:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403406.554709:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789403406.554798:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786048 00000100:00100000:1.0:1789403406.554805:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786048 00000100:00100000:1.0:1789403406.554840:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403406.554858:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050786048:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789403406.554880:0:17226:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:1.0:1789403406.554917:0:17226:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb08b1e5b761e7a 00000004:00100000:1.0:1789403406.554940:0:17226:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403406.554967:0:17226:0:(import.c:65:import_set_state_nolock()) ffff90a281a0a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403406.555025:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876325050786048:12345-0@lo:38:llog_process_th.0 Request processed in 176us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403406.555032:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789403406.555156:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144183800 x1876325050786048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403406.555165:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403406.555171:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789403406.555177:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789403406.555180:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789403406.555182:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d294000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789403406.555187:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050786048:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789403406.559772:0:17975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789403406.559820:0:17956:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789403406.559862:0:17956:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403406.559879:0:17956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403406.559891:0:17956:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789403406.559939:0:17956:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789403406.559941:0:17956:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789403406.559943:0:17956:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403406.559944:0:17956:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403406.559945:0:17956:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403406.559946:0:17956:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403406.559948:0:17956:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403406.559956:0:17956:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403406.559957:0:17956:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403406.559961:0:17956:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789403406.559963:0:17956:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789403406.559964:0:17956:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789403406.559965:0:17956:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403406.559966:0:17956:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403406.559967:0:17956:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403406.559968:0:17956:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403406.559969:0:17956:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403406.559970:0:17956:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403406.559970:0:17956:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403406.559993:0:17956:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789403406.560013:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050786176:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789403406.560077:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.560120:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403406.561441:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786176 00000100:00100000:3.0:1789403406.561462:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786176 00000100:00100000:3.0:1789403406.561510:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403406.561521:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17956:x1876325050786176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789403406.561563:0:17219:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789403406.561577:0:17219:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789403406.565039:0:17204:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789403406.565073:0:17219:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789403406.565082:0:17219:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789403406.565150:0:17240:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789403406.565155:0:17240:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789403406.565177:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565196:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 18 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565204:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565211:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565246:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565260:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 18 pid: 17217 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.565273:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050786304:0@lo:104: 00000100:00100000:3.0:1789403406.565333:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403406.565376:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 18 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565420:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 18 pid: 17219 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.565430:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050786432:0@lo:104: 00000100:00100000:3.0:1789403406.565454:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.565471:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403406.565490:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786304 00000100:00100000:3.0:1789403406.565497:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786304 00000100:00100000:3.0:1789403406.565680:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786432 00000100:00100000:3.0:1789403406.565684:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786432 00000100:00100000:3.0:1789403406.565716:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403406.565725:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:17240:x1876325050786304:12345-0@lo:104: 00010000:00010000:3.0:1789403406.565737:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.565789:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789403406.565795:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:17240:x1876325050786304:12345-0@lo:104: Request processed in 73us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.565802:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403406.565819:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403406.565824:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050786432:12345-0@lo:104: 00010000:00010000:3.0:1789403406.565832:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.566356:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789403406.566362:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050786432:12345-0@lo:104: Request processed in 538us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.566378:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789403406.566432:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403406.566438:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.566446:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403406.566450:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.566458:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403406.566465:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403406.566471:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403406.566501:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.566508:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403406.566627:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403406.566659:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.566668:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e9a00/0x5fb08b1e5b761e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e49 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.566679:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403406.566680:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403406.566682:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403406.566696:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050786560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403406.566734:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403406.566782:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786560 00000100:00100000:3.0:1789403406.566788:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786560 00010000:00010000:3.0:1789403406.566808:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 19 pid: 17217 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.566831:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403406.566838:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3627:x1876325050786560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403406.567134:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403406.567137:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403406.567139:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403406.567179:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.567199:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403406.567203:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.567210:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403406.567216:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403406.567222:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789403406.567239:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.567245:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403406.567274:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.567282:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947e00/0x5fb08b1e5b761d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d85 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403406.567297:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403406.567299:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403406.567301:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403406.567327:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403406.567334:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 19 pid: 17217 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.567345:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 19 pid: 17217 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.567360:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403406.567437:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403406.567447:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050786688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403406.567474:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403406.567610:0:17211:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789403406.567618:0:17211:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789403406.567785:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3627:x1876325050786560:12345-0@lo:103:ldlm_bl.0 Request processed in 947us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.567793:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403406.567809:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786688 00000100:00100000:3.0:1789403406.567813:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786688 00010000:00010000:3.0:1789403406.567827:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 19 pid: 17219 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.567840:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403406.567846:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3629:x1876325050786688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403406.568053:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403406.568059:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 19 pid: 17219 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568079:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 19 pid: 17219 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568097:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568104:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789403406.568115:0:17209:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005843417s 00010000:00010000:3.0:1789403406.568120:0:17209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568127:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568133:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568150:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568156:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403406.568160:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568167:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568175:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568191:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403406.568263:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3629:x1876325050786688:12345-0@lo:103:ldlm_bl.0 Request processed in 417us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.568270:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403406.568321:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050786560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403406.568348:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947000/0x5fb08b1e5b761e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761e42 expref: 18 pid: 17217 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.568358:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050786304:0@lo:104: 00010000:00010000:3.0:1789403406.568367:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8a00/0x5fb08b1e5b761d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761d7e expref: 17 pid: 17219 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.568374:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050786432:0@lo:104: 00010000:00010000:3.0:1789403406.568414:0:17240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568423:0:17240:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568429:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403406.568434:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403406.568495:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17956:x1876325050786176:12345-0@lo:253:mount.lustre.0 Request processed in 6978us (8419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403406.568512:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403406.568583:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17956:1876325050786176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403406.568593:0:17956:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789403406.568596:0:17956:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403406.568598:0:17956:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789403406.568599:0:17956:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403406.568600:0:17956:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403406.568602:0:17956:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403406.568603:0:17956:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403406.568604:0:17956:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789403406.568606:0:17956:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403406.568607:0:17956:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789403406.568617:0:17956:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789403406.574003:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050786688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403406.577710:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789403406.579510:0:17956:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789403406.579606:0:17982:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789403406.579610:0:17982:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789403406.580239:0:17983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789403406.580614:0:17983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789403406.584377:0:17956:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789403406.584846:0:17984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17984:1876325050786816:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.584930:0:17984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.584971:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786816 00000100:00100000:0.0:1789403406.584978:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786816 00000100:00100000:0.0:1789403406.585017:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403406.585026:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17984:x1876325050786816:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.585103:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17984:x1876325050786816:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.585112:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403406.585148:0:17984:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.585176:0:17984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17984:1876325050786816:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789403406.585205:0:17984:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789403406.585233:0:17984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17984:1876325050786944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.585280:0:17984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.585298:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050786944 00000100:00100000:0.0:1789403406.585302:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050786944 00000100:00100000:0.0:1789403406.585323:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403406.585330:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17984:x1876325050786944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.585464:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17984:x1876325050786944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.585470:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403406.585489:0:17984:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146240 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.585503:0:17984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17984:1876325050786944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.585788:0:17984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17984:1876325050787072:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.585817:0:17984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.585842:0:17984:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403406.585856:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787072 00000100:00100000:2.0:1789403406.585863:0:17235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787072 00000100:00100000:2.0:1789403406.585891:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403406.585899:0:17235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17984:x1876325050787072:12345-0@lo:900:lod0001_rec0000.0 00000040:01000000:1.0:1789403406.586084:0:17956:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789403406.586123:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403406.586328:0:17235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17984:x1876325050787072:12345-0@lo:900:lod0001_rec0000.0 Request processed in 430us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403406.586336:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00000080:1.0:1789403406.586673:0:17956:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789403406.586680:0:17956:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789403406.586719:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1789403406.587894:0:17984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a14418f800 x1876325050787072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403406.587909:0:17984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17984:1876325050787072:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.587975:0:17984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17984:1876325050787200:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.588016:0:17984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403406.588049:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787200 00000100:00100000:0.0:1789403406.588054:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787200 00000100:00100000:0.0:1789403406.588087:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403406.588095:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17984:x1876325050787200:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403406.588182:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17984:x1876325050787200:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403406.588189:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403406.588220:0:17984:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403406.588234:0:17984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17984:1876325050787200:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789403406.588272:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403406.588908:0:17983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789403406.588970:0:17983:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789403406.591192:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789403406.591881:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789403406.591921:0:17956:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789403406.592091:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403406.593431:0:17984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789403406.593502:0:17984:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789403406.593507:0:17984:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1789403406.593989:0:17956:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1789403406.600270:0:17956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789403406.602500:0:17956:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789403406.602536:0:17956:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb21c1993988 00100000:10000000:0.0:1789403406.602544:0:17956:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789403406.603356:0:17956:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789403406.603430:0:17956:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789403406.603451:0:17956:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789403406.603467:0:17956:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789403406.604354:0:17956:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403406.608440:0:17956:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789403406.906706:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000040:00080000:0.0:1789403407.605374:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403407.605824:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403407.925435:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 10000000:01000000:2.0:1789403408.178161:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789403408.178168:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b17800 from 8 10000000:01000000:2.0:1789403408.178172:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789403408.178215:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403408.178227:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403408.178239:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403408.178278:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403408.178353:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403408.178423:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789403408.178760:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787328 00000100:00100000:3.0:1789403408.178769:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787328 00000100:00100000:3.0:1789403408.178824:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789403408.178833:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17221:x1876325050787328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403408.178914:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403408.178996:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761e88 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403408.179021:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 17 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403408.179047:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 17 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403408.179056:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947c00, rc 0) 00000100:00100000:3.0:1789403408.179109:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050787328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403408.179116:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789403408.179734:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403408.179754:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403408.179764:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403408.179823:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789403408.180040:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403408.180762:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27cf929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403408.184600:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787456 00000100:00100000:2.0:1789403408.184614:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787456 00000100:00100000:2.0:1789403408.184782:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789403408.184793:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050787456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789403408.184819:0:17219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789403408.184835:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789403408.184849:0:17219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789403408.184984:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050787456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (4943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403408.184992:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789403408.185088:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789403408.185153:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403408.185163:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403408.185174:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403408.185185:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403408.185187:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a14452d000 from 8 10000000:01000000:1.0:1789403408.185190:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403408.185219:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403408.185237:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403408.185247:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403408.185266:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403408.185299:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403408.187746:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2528b4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403408.187934:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787584 00000100:00100000:0.0:1789403408.187943:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787584 00000100:00100000:0.0:1789403408.187991:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789403408.188000:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050787584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403408.188016:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403408.188047:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761e96 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403408.188074:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403408.188084:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 18 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403408.188093:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8200, rc 0) 00000100:00100000:0.0:1789403408.188169:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050787584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403408.188176:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789403408.188431:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403408.188457:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403408.188467:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403408.188658:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403408.188699:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403408.188724:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2528b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403408.188737:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787712 00000100:00100000:1.0:1789403408.188741:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787712 00000100:00100000:1.0:1789403408.188763:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403408.188768:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050787712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403408.188782:0:17217:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403408.188797:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403408.188800:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789403408.188997:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050787712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 227us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403408.189004:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403408.189034:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050787712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789403408.189069:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403408.189076:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403408.189085:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403408.628182:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403408.628415:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403408.952726:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:2.0:1789403409.649595:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403409.974892:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00010000:00010000:0.0:1789403410.674984:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403410.999938:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 0 seconds 00000001:02000400:2.0:1789403411.102658:0:18227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789403411.700724:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403411.700768:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050787840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403411.700856:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403411.700924:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787840 00000100:00100000:0.0:1789403411.700932:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787840 00000100:00100000:0.0:1789403411.700976:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403411.700984:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050787840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403411.701016:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789403411.701063:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050787840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403411.701069:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403411.701124:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050787840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403411.704510:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050787968:0@lo:400:kworker.0 00000100:00100000:2.0:1789403411.704741:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403411.704762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789403411.704769:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789403411.704773:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1789403411.704919:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050787968 00000100:00100000:2.0:1789403411.704928:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050787968 00000100:00080000:1.0:1789403411.704955:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a1436b4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403411.704983:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789403411.704994:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:3626:x1876325050787968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403411.705063:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:3626:x1876325050787968:12345-0@lo:400:kworker.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403411.705070:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789403411.705190:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050787968:0@lo:400:kworker.0 00000100:00100000:0.0:1789403411.708494:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418d180 x1876325050788096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403411.708530:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403411.708535:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403411.708538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403411.708541:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403411.708579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403411.708583:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403411.708586:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403411.708589:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403411.708622:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050788352:0@lo:400:kworker.0 00000100:00100000:2.0:1789403411.708700:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403411.708753:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403411.708761:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050788224:0@lo:400:kworker.0 00000100:00100000:2.0:1789403411.708786:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403411.708818:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788352 00000100:00100000:2.0:1789403411.708819:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788224 00000100:00100000:2.0:1789403411.708826:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788224 00000100:00100000:0.0:1789403411.708826:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788352 00000100:00100000:0.0:1789403411.708870:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403411.708880:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050788352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403411.708939:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050788352:12345-0@lo:400:kworker.0 Request processed in 60us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403411.708948:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403411.708998:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403411.709005:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050788224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403411.709009:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050788096:0@lo:38:kworker.0 00000100:00100000:3.0:1789403411.709042:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403411.709135:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050788224:12345-0@lo:400:kworker.0 Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403411.709332:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789403411.709374:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a14418e300 x1876325050788352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403411.709412:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050788352:0@lo:400:kworker.0 00010000:00080000:3.0:1789403411.709416:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a14418d880 x1876325050788224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403411.709424:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050788224:0@lo:400:kworker.0 00000100:00100000:1.0:1789403411.709487:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788096 00000100:00100000:1.0:1789403411.709493:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788096 00000100:00100000:1.0:1789403411.709527:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403411.709533:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050788096:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789403411.709566:0:17230:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:1.0:1789403411.709600:0:17230:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b761ea4 00000004:00100000:1.0:1789403411.709614:0:17230:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789403411.709620:0:17230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1789403411.725427:0:17230:0:(import.c:65:import_set_state_nolock()) ffff90a2702b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403411.725519:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050788096:12345-0@lo:38:kworker.0 Request processed in 15983us (16474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403411.725528:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789403411.725738:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789403411.725749:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789403411.725754:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789403411.725757:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789403411.725785:0:3625:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009217fac5): req@ffff90a1442b6a00 x1876325050781056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403411.725816:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050788096:0@lo:38:kworker.0 00000100:00100000:2.0:1789403411.725928:0:17265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403411.725959:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403411.726140:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050781056 00000100:00100000:1.0:1789403411.726147:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050781056 00000100:00100000:1.0:1789403411.726189:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403411.726198:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17265:x1876325050781056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789403411.726272:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17265:x1876325050781056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403411.726279:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403411.726319:0:17265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17265:1876325050781056:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789403411.726360:0:17265:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789403411.726424:0:17265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17265:1876325050788480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789403411.726457:0:17265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403411.726480:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403411.726491:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788480 00000100:00100000:1.0:1789403411.726496:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788480 00000100:00100000:1.0:1789403411.726513:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403411.726519:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17265:x1876325050788480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789403411.726978:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17265:x1876325050788480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 457us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403411.727002:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403411.727079:0:17265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17265:1876325050788480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403411.727162:0:17265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17265:1876325050788608:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403411.727189:0:17265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403411.727211:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403411.727263:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788608 00000100:00100000:1.0:1789403411.727268:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788608 00000100:00100000:1.0:1789403411.727364:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403411.727373:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17265:x1876325050788608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789403411.727453:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17265:x1876325050788608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403411.727459:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789403411.727485:0:17265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17265:1876325050788608:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789403411.727525:0:17265:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403411.728753:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403411.728769:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050788736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403411.728832:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403411.730415:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788736 00000100:00100000:0.0:1789403411.730427:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788736 00000100:00100000:0.0:1789403411.730521:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403411.730531:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050788736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789403411.730578:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789403411.730644:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050788736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403411.730651:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:1.0:1789403411.740540:0:17265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789403411.740636:0:17265:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:1.0:1789403411.740641:0:17265:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1789403411.741123:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050788736:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1789403412.223382:0:18279:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403412.223700:0:18279:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789403412.724280:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403413.204188:0:18329:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403413.208457:0:18329:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403413.745835:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789403414.247935:0:18377:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe96ba5f60 20000000:00000080:3.0:1789403414.247953:0:18377:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a27ceb2c00 uarg=0000000000000000 20000000:01000000:3.0:1789403414.247992:0:18377:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789403414.247999:0:18377:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789403414.248005:0:18377:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789403414.249164:0:18378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789403414.250944:0:18377:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789403414.265574:0:18377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789403414.265682:0:18377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403414.265702:0:18377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 17 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403414.265710:0:18377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 17 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403414.265718:0:18377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403414.265765:0:18377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 17 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403414.265911:0:18377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 17 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403414.265926:0:18377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18377:1876325050788864:0@lo:104: 00000100:00100000:1.0:1789403414.265992:0:18377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403414.266104:0:18377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 17 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403414.266113:0:18377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 17 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403414.266122:0:18377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18377:1876325050788992:0@lo:104: 00000100:00100000:1.0:1789403414.266156:0:18377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403414.266335:0:18377:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403414.266650:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788864 00000100:00100000:3.0:1789403414.266659:0:17208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788864 00000100:00100000:3.0:1789403414.266696:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050788992 00000100:00100000:3.0:1789403414.266699:0:17208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050788992 00000100:00100000:3.0:1789403414.266713:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403414.266723:0:17208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:18377:x1876325050788864:12345-0@lo:104: 00010000:00010000:3.0:1789403414.266735:0:17208:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.266877:0:17208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403414.266886:0:17208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:18377:x1876325050788864:12345-0@lo:104: Request processed in 164us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403414.266899:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403414.266919:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403414.266925:0:17208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:18377:x1876325050788992:12345-0@lo:104: 00010000:00010000:2.0:1789403414.266932:0:17208:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.266966:0:17208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403414.266971:0:17208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:18377:x1876325050788992:12345-0@lo:104: Request processed in 48us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403414.266976:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789403414.266994:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403414.266999:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267007:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403414.267010:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267020:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403414.267027:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403414.267032:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789403414.267059:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267065:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403414.267101:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267107:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b761e50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e57 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267117:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403414.267121:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267126:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403414.267129:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267143:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403414.267149:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403414.267154:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789403414.267167:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267173:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403414.267178:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267303:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e9600/0x5fb08b1e5b761d4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761d54 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267326:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403414.267328:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403414.267330:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403414.267337:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403414.267358:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050789120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403414.267430:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403414.267583:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403414.267591:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050789248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403414.267615:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403414.267647:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789120 00000100:00100000:2.0:1789403414.267651:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789120 00010000:00010000:2.0:1789403414.267672:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 18 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403414.267692:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789248 00000100:00100000:2.0:1789403414.267695:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789248 00010000:00010000:2.0:1789403414.267706:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 19 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403414.267724:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403414.267730:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3626:x1876325050789120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403414.267741:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403414.267746:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 19 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267756:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 19 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267781:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403414.267814:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3626:x1876325050789120:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403414.267820:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403414.267835:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403414.267841:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:3626:x1876325050789248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403414.267861:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403414.267866:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 18 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267875:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 18 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267886:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267895:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267908:0:17209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267916:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267923:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267929:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267941:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403414.267946:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267953:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267962:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403414.267971:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403414.267993:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:3626:x1876325050789248:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403414.267999:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403414.268033:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050789248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403414.268040:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050789120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403414.268149:0:18377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05400/0x5fb08b1e5b761e57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761e50 expref: 17 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403414.268160:0:18377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18377:1876325050788864:0@lo:104: 00010000:00010000:3.0:1789403414.268169:0:18377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761d4d expref: 16 pid: 17219 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403414.268176:0:18377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18377:1876325050788992:0@lo:104: 00010000:00010000:3.0:1789403414.268196:0:18377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403414.268204:0:18377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403414.268210:0:18377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403414.268215:0:18377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761eab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403414.775882:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403415.090199:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789403415.794407:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789403416.049502:0:17221:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789403416.049512:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b17800 from 13 10000000:01000000:2.0:1789403416.049519:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403416.049578:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403416.049592:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403416.049606:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403416.049653:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403416.049742:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403416.049800:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403416.049871:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789376 00000100:00100000:0.0:1789403416.049883:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789376 00000100:00100000:0.0:1789403416.049952:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789403416.049962:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+16:17221:x1876325050789376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403416.049980:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403416.049996:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761eb2 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.050026:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 17 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.050037:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 17 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.050047:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8600, rc 0) 00000100:00100000:0.0:1789403416.050127:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050789376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403416.050135:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403416.050243:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403416.050261:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403416.050270:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403416.050357:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403416.050434:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403416.050457:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403416.050510:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789504 00000100:00100000:2.0:1789403416.050515:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789504 00000100:00100000:2.0:1789403416.050553:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789403416.050561:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050789504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403416.050691:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050789504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403416.050699:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789403416.050759:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403416.050790:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403416.050834:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403416.050853:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403416.050899:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789632 00000100:00100000:0.0:1789403416.050903:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789632 00000100:00100000:0.0:1789403416.050933:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789403416.050940:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050789632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.051025:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050789632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403416.051032:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789403416.051082:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789403416.051888:0:18452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789403416.051952:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789403416.051977:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789403416.051987:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.051999:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403416.052011:0:17221:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789403416.052013:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a14452d000 from 13 10000000:01000000:0.0:1789403416.052016:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403416.052047:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.052056:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.052094:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403416.052114:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.052163:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403416.052182:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a600300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403416.052199:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789760 00000100:00100000:0.0:1789403416.052205:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789760 00000100:00100000:0.0:1789403416.052233:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789403416.052241:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+17:17221:x1876325050789760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403416.052251:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403416.052263:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761ec0 expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.052283:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 18 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.052294:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 18 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.052303:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9400, rc 0) 00000100:00100000:0.0:1789403416.052331:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050789760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403416.052338:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789403416.052376:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403416.052409:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.052425:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403416.052471:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.052494:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403416.052506:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a600300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403416.052515:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050789888 00000100:00100000:0.0:1789403416.052518:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050789888 00000100:00100000:0.0:1789403416.052533:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789403416.052538:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050789888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.052638:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050789888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403416.052644:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789403416.052670:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050789888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.052693:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050790016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.052727:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403416.052739:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a600300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403416.052749:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050790016 00000100:00100000:0.0:1789403416.052752:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050790016 00000100:00100000:0.0:1789403416.052766:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789403416.052771:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050790016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403416.052842:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:17221:x1876325050790016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403416.052849:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789403416.052894:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050790016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403416.059526:0:18453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789403416.060010:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789403416.060038:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789403416.060052:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403416.060066:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403416.817474:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403406/real 1789403406] req@ffff90a1442b7100 x1876325050784256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403416.817521:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a1442b7100 x1876325050784256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403416.817533:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403406/real 1789403406] req@ffff90a1442b4700 x1876325050784128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403416.817544:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a1442b4700 x1876325050784128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403416.817565:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403416.817585:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789403416.817590:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050784256:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789403416.817596:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403416.817600:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789403416.817603:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050784128:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789403416.817673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403416.817678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403416.817681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403416.817683:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403416.817705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403416.817709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789403416.817712:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403416.817717:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1789403416.817721:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789403416.817732:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a26d2d3000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403416.817758:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144180700 x1876325050790528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403416.817770:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403416.817773:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789403416.817775:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403416.817777:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1789403416.817780:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789403416.817785:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a141b05800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403416.817793:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144183100 x1876325050790656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403416.817820:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050790272:0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.817887:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403416.817918:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403416.817925:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050790144:0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.817950:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403416.817974:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050790400:0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.818001:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403416.818016:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403416.818021:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050790784:0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.818043:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403416.818087:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050790272 00000100:00100000:1.0:1789403416.818095:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050790272 00000100:00100000:1.0:1789403416.818135:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050790784 00000100:00100000:1.0:1789403416.818137:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050790784 00000100:00100000:1.0:1789403416.818153:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403416.818162:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050790528:0@lo:8:kworker.0 00000100:00100000:1.0:1789403416.818166:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050790272:12345-0@lo:400:kworker.0 00000400:00000100:3.0:1789403416.818193:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050790528 offset 0 length 520: 4 00000100:00100000:1.0:1789403416.818234:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050790272:12345-0@lo:400:kworker.0 Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403416.818238:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050790656:0@lo:8:kworker.0 00000100:00100000:1.0:1789403416.818244:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403416.818262:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403416.818269:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050790784:12345-0@lo:400:kworker.0 00000400:00000100:3.0:1789403416.818277:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050790656 offset 0 length 520: 4 00000100:00100000:1.0:1789403416.818310:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050790784:12345-0@lo:400:kworker.0 Request processed in 42us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403416.818316:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403416.818424:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050790144 00000100:00100000:1.0:1789403416.818428:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050790144 00000100:00100000:1.0:1789403416.818447:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050790400 00000100:00100000:1.0:1789403416.818449:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050790400 00000100:00100000:1.0:1789403416.818463:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403416.818469:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050790144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.818509:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050790144:12345-0@lo:400:kworker.0 Request processed in 40us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403416.818516:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403416.818528:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403416.818535:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050790400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.818673:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050790400:12345-0@lo:400:kworker.0 Request processed in 138us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403416.818679:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789403416.818717:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a144181880 x1876325050790784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403416.818730:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050790784:0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.818755:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050790400:0@lo:400:kworker.0 00000100:00100000:1.0:1789403416.818787:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050790144:0@lo:400:kworker.0 00010000:00080000:1.0:1789403416.818801:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a144181c00 x1876325050790272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403416.818810:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050790272:0@lo:400:kworker.0 00010000:00010000:0.0:1789403416.818850:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403416.819195:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403416.819206:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050790912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403416.819233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403416.822474:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050791040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403416.822534:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403416.823130:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050790912 00000100:00100000:3.0:1789403416.823139:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050790912 00000100:00100000:3.0:1789403416.823175:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050791040 00000100:00100000:3.0:1789403416.823178:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050791040 00000100:00100000:3.0:1789403416.823193:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403416.823200:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050790912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403416.823230:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789403416.823302:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050790912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (4068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403416.823309:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403416.823457:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789403416.823465:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050791040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403416.823482:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403416.823513:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050791040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403416.823519:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403416.823727:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050791040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403416.823741:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050790912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403417.842830:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789403417.850866:0:17957:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789403418.872285:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789403418.875666:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789403419.889531:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403419.905904:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403404/real 1789403404] req@ffff90a14418fb80 x1876325050782208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403419.905934:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a14418fb80 x1876325050782208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403419.905943:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403404/real 1789403404] req@ffff90a14418c700 x1876325050782336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403419.905953:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a14418c700 x1876325050782336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789403419.905970:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403419.905996:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789403419.906000:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050782208:0@lo:8:kworker.0 00000100:00080000:0.0:1789403419.906006:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403419.906011:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789403419.906014:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050782336:0@lo:8:kworker.0 00000100:00080000:3.0:1789403419.906132:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403419.906136:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789403419.906139:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403419.906145:0:17331:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789403419.906151:0:17331:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789403419.906162:0:17331:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a1436b1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403419.906183:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b5c00 x1876325050791424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403419.906211:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403419.906216:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403419.906218:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403419.906223:0:17331:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1789403419.906226:0:17331:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789403419.906234:0:17331:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a26d2d2000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403419.906249:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b7480 x1876325050791552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403419.906282:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403419.906285:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403419.906288:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403419.906290:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789403419.906313:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050791296:0@lo:400:kworker.0 00000100:00100000:3.0:1789403419.906374:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403419.906443:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789403419.906450:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050791168:0@lo:400:kworker.0 00000100:00100000:3.0:1789403419.906480:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403419.906499:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050791936:0@lo:400:kworker.0 00000100:00100000:3.0:1789403419.906527:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403419.906566:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050791808:0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.906690:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050791680:0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.906720:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403419.906754:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050791168 00000100:00100000:0.0:1789403419.906762:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050791168 00000100:00100000:0.0:1789403419.906804:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403419.906812:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:3627:x1876325050791168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.906859:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:3627:x1876325050791168:12345-0@lo:400:kworker.0 Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403419.906866:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403419.906896:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050791936 00000100:00100000:0.0:1789403419.906899:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050791936 00000100:00100000:0.0:1789403419.906923:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050791680 00000100:00100000:0.0:1789403419.906927:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050791680 00000100:00100000:0.0:1789403419.906940:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403419.906946:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050791936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.906979:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050791936:12345-0@lo:400:kworker.0 Request processed in 32us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403419.906985:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403419.906997:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403419.907003:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050791680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.907034:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050791680:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403419.907053:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403419.907087:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050791168:0@lo:400:kworker.0 00010000:00080000:0.0:1789403419.907098:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a1442b6a00 x1876325050791936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403419.907122:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050791936:0@lo:400:kworker.0 00010000:00080000:0.0:1789403419.907154:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a1442b4700 x1876325050791680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403419.907163:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050791680:0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.907181:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050791424:0@lo:8:kworker.0 00000400:00000100:0.0:1789403419.907204:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050791424 offset 0 length 520: 4 00000100:00100000:0.0:1789403419.907218:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050791552:0@lo:8:kworker.0 00000400:00000100:0.0:1789403419.907235:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050791552 offset 0 length 520: 4 00000100:00100000:3.0:1789403419.907375:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403419.907461:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050791296 00000100:00100000:3.0:1789403419.907466:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050791296 00000100:00100000:3.0:1789403419.907495:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050791808 00000100:00100000:3.0:1789403419.907498:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050791808 00000100:00100000:3.0:1789403419.907514:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789403419.907522:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050791296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403419.907752:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050791296:12345-0@lo:400:kworker.0 Request processed in 229us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403419.907761:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789403419.907777:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403419.907786:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050791808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403419.907833:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050791808:12345-0@lo:400:kworker.0 Request processed in 46us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403419.907840:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403419.907888:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050791808:0@lo:400:kworker.0 00000100:00100000:0.0:1789403419.907975:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050791296:0@lo:400:kworker.0 00010000:00010000:2.0:1789403420.919113:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789403420.939897:0:18726:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789403420.939902:0:18726:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789403420.939904:0:18726:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789403420.940308:0:18726:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a2702b7000 00000020:01000004:0.0:1789403420.940863:0:18726:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789403420.940881:0:18726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789403420.940901:0:18726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a2818719c0) 00000020:00000080:0.0:1789403420.940922:0:18726:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789403421.096162:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789403421.113584:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789403421.114350:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789403421.114874:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789403421.115306:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789403421.115711:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789403421.116071:0:18726:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1789403421.121804:0:18726:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789403421.123195:0:18726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789403421.123216:0:18726:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789403421.123234:0:18726:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb08b1e5b761ed5 00000020:01000004:3.0:1789403421.123247:0:18726:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789403421.123274:0:18726:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789403421.123278:0:18726:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789403421.123285:0:18726:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789403421.123310:0:18726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789403421.123328:0:18726:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a27c3619c0) 00000020:00000080:3.0:1789403421.123343:0:18726:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789403421.128846:0:18726:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789403421.129660:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789403421.129671:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789403421.143994:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789403421.144013:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789403421.144530:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789403421.144636:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789403421.151507:0:18726:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403421.151691:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789403421.151697:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789403421.154310:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789403421.154324:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789403421.201586:0:18726:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403421.201822:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789403421.201828:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789403421.205850:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789403421.205883:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789403421.206939:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789403421.206949:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789403421.213871:0:18726:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403421.214087:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789403421.214094:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789403421.221459:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789403421.221479:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789403421.266613:0:18726:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403421.266809:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789403421.266815:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789403421.270794:0:18726:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789403421.270812:0:18726:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789403421.271754:0:18726:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789403421.271785:0:18726:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789403421.271791:0:18726:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789403421.292218:0:18726:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789403421.293560:0:18726:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789403421.293567:0:18726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789403421.293569:0:18726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789403421.293570:0:18726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403421.293572:0:18726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403421.293573:0:18726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403421.293575:0:18726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403421.293576:0:18726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403421.293577:0:18726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403421.293579:0:18726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403421.293583:0:18726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789403421.293586:0:18726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789403421.293588:0:18726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789403421.293589:0:18726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403421.293590:0:18726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403421.293591:0:18726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403421.293592:0:18726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403421.293593:0:18726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403421.293594:0:18726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403421.293595:0:18726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403421.293622:0:18726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789403421.293643:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789403421.293713:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.293800:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792064 00000100:00100000:2.0:1789403421.293807:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792064 00000100:00100000:3.0:1789403421.293808:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a250722a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.293871:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403421.293880:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:18726:x1876325050792064:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789403421.293925:0:17217:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789403421.293929:0:17217:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789403421.293932:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789403421.294372:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:18726:x1876325050792064:12345-0@lo:253:mount.lustre.0 Request processed in 493us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.294381:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403421.294579:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792064:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403421.294592:0:18726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789403421.294601:0:18726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403421.294603:0:18726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789403421.294604:0:18726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403421.294605:0:18726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403421.294606:0:18726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403421.294607:0:18726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403421.294608:0:18726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403421.294610:0:18726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403421.294611:0:18726:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789403421.294628:0:18726:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a2702b7000 from lustre-OST0000 10000000:01000000:3.0:1789403421.294664:0:18726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789403421.294667:0:18726:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789403421.294675:0:18726:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a142648000 local copy 00010000:00010000:3.0:1789403421.294686:0:18726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403421.295162:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403421.295197:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403421.295280:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244840 going to sleep for 11 seconds 00000100:00100000:0.0:1789403421.297712:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792192 00000100:00100000:0.0:1789403421.297726:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792192 00000100:00100000:2.0:1789403421.298424:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789403421.298434:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:18726:x1876325050792192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403421.298552:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:18726:x1876325050792192:12345-0@lo:501:mount.lustre.0 Request processed in 120us (3353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789403421.298560:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789403421.298772:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792192:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789403421.298794:0:18726:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789403421.298817:0:18726:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789403421.298825:0:18726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.298837:0:18726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403421.298864:0:18726:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a2702b7000 10000000:01000000:3.0:1789403421.298868:0:18726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789403421.298874:0:18726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789403421.298888:0:18726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403421.298893:0:18726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789403421.298896:0:18726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789403421.298921:0:18726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.298929:0:18726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.298936:0:18726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403421.298953:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403421.298997:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403421.299026:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244840 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.299082:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792320 00000100:00100000:2.0:1789403421.299088:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792320 00000100:00100000:2.0:1789403421.299121:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403421.299127:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+18:18726:x1876325050792320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403421.299136:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403421.299149:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c7a00/0x5fb08b1e5b761eea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761ee3 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.299169:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c7a00/0x5fb08b1e5b761eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ee3 expref: 19 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.299178:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c7a00/0x5fb08b1e5b761eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ee3 expref: 19 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.299186:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7a00, rc 0) 00000100:00100000:2.0:1789403421.299229:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792320:12345-0@lo:101:mount.lustre.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.299235:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789403421.299306:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403421.299318:0:18726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.299326:0:18726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403421.300572:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789403421.304084:0:18726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403421.306622:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789403421.306683:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789403421.306698:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789403421.306723:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789403421.306821:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789403421.306849:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789403421.306888:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789403421.306894:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789403421.307094:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403421.307161:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.307265:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526180 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.314056:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792448 00000100:00100000:2.0:1789403421.314070:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792448 00000100:00100000:2.0:1789403421.314170:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789403421.314181:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403421.314367:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792448:12345-0@lo:501:mount.lustre.0 Request processed in 189us (7206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.314375:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789403421.314487:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403421.314534:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403421.314587:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.317928:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792576 00000100:00100000:1.0:1789403421.317942:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792576 00000100:00100000:1.0:1789403421.318012:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789403421.318037:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403421.318100:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244300 going to sleep for 11 seconds 00000100:00100000:1.0:1789403421.318827:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792576:12345-0@lo:503:mount.lustre.0 Request processed in 805us (4238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403421.318837:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789403421.319040:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789403421.319742:0:18726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789403421.319904:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403421.319956:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.319993:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526840 going to sleep for 11 seconds 00000100:00100000:0.0:1789403421.320103:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792704 00000100:00100000:0.0:1789403421.320110:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792704 00000100:00100000:0.0:1789403421.320151:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789403421.320160:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403421.320814:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792704:12345-0@lo:502:mount.lustre.0 Request processed in 654us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403421.320823:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789403421.320903:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789403421.321104:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789403421.321141:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789403421.321155:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789403421.321185:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789403421.321206:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789403421.321218:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789403421.321231:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789403421.321242:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789403421.321254:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789403421.321265:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789403421.321276:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789403421.321287:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789403421.321315:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403421.321882:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.321995:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526840 going to sleep for 11 seconds 00000100:00100000:3.0:1789403421.322799:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792832 00000100:00100000:3.0:1789403421.322808:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792832 00000100:00100000:3.0:1789403421.322851:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789403421.322861:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403421.323003:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792832:12345-0@lo:502:mount.lustre.0 Request processed in 143us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403421.323010:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789403421.323168:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789403421.323236:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789403421.323249:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789403421.324270:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403421.324279:0:18743:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789403421.324285:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.324287:0:18743:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789403421.324293:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403421.324308:0:18743:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a2818099c0) 00000020:00000080:1.0:1789403421.324333:0:18743:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789403421.324339:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789403421.324537:0:18743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a2702b7000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789403421.324546:0:18743:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789403421.324554:0:18743:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb08b1e5b761ef8 00010000:00010000:1.0:1789403421.330067:0:18743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789403421.330856:0:18743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789403421.334281:0:18743:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789403421.335679:0:18743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789403421.335690:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403421.335696:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.335698:0:18743:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789403421.335701:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403421.335704:0:18743:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789403421.335706:0:18743:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403421.335707:0:18743:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403421.335709:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403421.335711:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.335712:0:18743:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403421.335714:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403421.335717:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.335718:0:18743:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789403421.335720:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789403421.335722:0:18743:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789403421.335723:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403421.335725:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.335726:0:18743:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789403421.335728:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403421.335730:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.335732:0:18743:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789403421.335734:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789403421.335771:0:18743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403421.335774:0:18743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403421.335775:0:18743:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789403421.335778:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789403421.335951:0:18726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789403421.335984:0:18726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789403421.336005:0:18726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.336016:0:18726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403421.336024:0:18726:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a2702b7000 from 1 10000000:01000000:2.0:1789403421.336027:0:18726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403421.336070:0:18726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.336078:0:18726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.336089:0:18726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403421.336115:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403421.336186:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.336233:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a270148cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403421.339526:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050792960 00000100:00100000:1.0:1789403421.339539:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050792960 00000100:00100000:1.0:1789403421.339591:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789403421.339601:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:18726:x1876325050792960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403421.339617:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403421.339634:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761eff expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.339668:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 20 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.339679:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 20 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.339687:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04000, rc 0) 00000100:00100000:1.0:1789403421.339757:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050792960:12345-0@lo:101:mount.lustre.0 Request processed in 157us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403421.339763:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789403421.339902:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050792960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403421.339920:0:18726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.339930:0:18726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403421.349835:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789403421.350110:0:18726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403421.350302:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789403421.350327:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789403421.350343:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789403421.350348:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789403421.350443:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403421.350505:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403421.350541:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.350645:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793088 00000100:00100000:2.0:1789403421.350652:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793088 00000100:00100000:2.0:1789403421.350699:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789403421.350708:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403421.350823:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793088:12345-0@lo:501:mount.lustre.0 Request processed in 116us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.350831:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789403421.350982:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403421.351019:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403421.351065:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403421.351094:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403421.351137:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793216 00000100:00100000:1.0:1789403421.351141:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793216 00000100:00100000:1.0:1789403421.351171:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789403421.351178:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403421.351264:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793216:12345-0@lo:503:mount.lustre.0 Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403421.351271:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789403421.351340:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789403421.351669:0:18726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403421.351724:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403421.351895:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403421.351950:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403421.353574:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793344 00000100:00100000:1.0:1789403421.353586:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793344 00000100:00100000:1.0:1789403421.353632:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789403421.353642:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403421.353797:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793344:12345-0@lo:502:mount.lustre.0 Request processed in 156us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403421.353804:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789403421.353962:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403421.354199:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789403421.354232:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789403421.354249:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789403421.354279:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789403421.354296:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789403421.354310:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789403421.354324:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789403421.354337:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789403421.354350:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789403421.354362:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789403421.354376:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789403421.354441:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403421.354484:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403421.354512:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403421.355894:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793472 00000100:00100000:3.0:1789403421.355906:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793472 00000100:00100000:3.0:1789403421.355946:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403421.355966:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24845cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403421.356122:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24845cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793472:12345-0@lo:502:mount.lustre.0 Request processed in 156us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403421.356129:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403421.356309:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403421.356378:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789403421.356416:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789403421.358833:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403421.358845:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358848:0:18747:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789403421.358855:0:18747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a2702b7000 00000020:00000080:2.0:1789403421.358858:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403421.358867:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403421.358869:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358870:0:18747:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789403421.358873:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403421.358875:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358876:0:18747:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789403421.358880:0:18747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a2702b7000 00000020:00000080:2.0:1789403421.358882:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403421.358942:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403421.358946:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358947:0:18747:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789403421.358950:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403421.358954:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358955:0:18747:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789403421.358958:0:18747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a2702b7000 00000020:00000080:2.0:1789403421.358960:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403421.358979:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403421.358987:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358988:0:18747:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789403421.358991:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403421.358993:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.358995:0:18747:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789403421.358997:0:18747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a2702b7000 00000020:00000080:2.0:1789403421.358999:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403421.359300:0:18747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403421.359305:0:18747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403421.359307:0:18747:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789403421.359311:0:18747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789403421.359842:0:18726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789403421.359872:0:18726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789403421.359890:0:18726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.359902:0:18726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403421.359967:0:18726:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789403421.359971:0:18726:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a2702b7000 10000000:01000000:0.0:1789403421.359974:0:18726:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a2702b7000 10000000:01000000:0.0:1789403421.359978:0:18726:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789403421.359985:0:18726:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a2702b7000 from 1 10000000:01000000:0.0:1789403421.359988:0:18726:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789403421.360021:0:18726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.360040:0:18726:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.360051:0:18726:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403421.360073:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403421.360132:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403421.360182:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.361419:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793600 00000100:00100000:2.0:1789403421.361430:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793600 00000100:00100000:2.0:1789403421.361478:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789403421.361487:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:18726:x1876325050793600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403421.361502:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403421.361517:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c6400/0x5fb08b1e5b761f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761f0d expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.361541:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c6400/0x5fb08b1e5b761f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f0d expref: 21 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.361550:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c6400/0x5fb08b1e5b761f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f0d expref: 21 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.361557:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6400, rc 0) 00000100:00100000:2.0:1789403421.361627:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793600:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.361634:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789403421.361910:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403421.361927:0:18726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.361953:0:18726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403421.372366:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789403421.372676:0:18726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403421.372919:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789403421.372945:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789403421.372959:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789403421.372970:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789403421.372984:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789403421.373012:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789403421.373038:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789403421.373054:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789403421.373066:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789403421.373077:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789403421.373089:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789403421.373100:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789403421.373113:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789403421.373125:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789403421.373136:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789403421.373148:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789403421.373161:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789403421.373172:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789403421.373183:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789403421.373195:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789403421.373206:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789403421.373234:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789403421.373250:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789403421.373263:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789403421.373276:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789403421.373288:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789403421.373300:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789403421.373311:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789403421.373322:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789403421.373333:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789403421.373345:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789403421.373357:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789403421.373370:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789403421.373423:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789403421.373439:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789403421.373452:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789403421.373465:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789403421.373496:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789403421.373504:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789403421.373579:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403421.373652:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.373698:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.373937:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793728 00000100:00100000:2.0:1789403421.373951:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793728 00000100:00100000:2.0:1789403421.385252:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789403421.385267:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403421.385447:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793728:12345-0@lo:501:mount.lustre.0 Request processed in 183us (11794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.385454:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403421.385589:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403421.385638:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403421.385685:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.385720:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.385765:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793856 00000100:00100000:2.0:1789403421.385772:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793856 00000100:00100000:2.0:1789403421.385806:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789403421.385813:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403421.385931:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793856:12345-0@lo:503:mount.lustre.0 Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.385938:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789403421.388549:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789403421.389010:0:18726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789403421.389110:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403421.389182:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.397050:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.399087:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050793984 00000100:00100000:2.0:1789403421.399102:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050793984 00000100:00100000:2.0:1789403421.399183:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789403421.399194:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403421.399367:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050793984:12345-0@lo:502:mount.lustre.0 Request processed in 175us (10184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.399375:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789403421.399385:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050793984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403421.400278:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789403421.400311:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789403421.400324:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789403421.400336:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789403421.400348:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789403421.400373:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789403421.400416:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789403421.400432:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789403421.400443:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789403421.400453:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789403421.400464:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789403421.400474:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789403421.400485:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789403421.400496:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789403421.400507:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789403421.400518:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789403421.400528:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789403421.400540:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789403421.400550:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789403421.400561:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789403421.401708:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789403421.402018:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789403421.402050:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789403421.402067:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789403421.402082:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789403421.402108:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789403421.402123:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789403421.402135:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789403421.402146:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789403421.402158:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789403421.402169:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789403421.402181:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789403421.402193:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789403421.402205:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789403421.402218:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789403421.402231:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789403421.402244:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789403421.402273:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789403421.402289:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789403421.402302:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789403421.402316:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789403421.402331:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789403421.402344:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789403421.402356:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789403421.402368:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789403421.402380:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789403421.402442:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789403421.402459:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789403421.402513:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050794112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403421.403465:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.405478:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a247d1b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403421.412969:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794112 00000100:00100000:0.0:1789403421.412984:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794112 00000100:00100000:0.0:1789403421.413110:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789403421.413122:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050794112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403421.413281:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050794112:12345-0@lo:502:mount.lustre.0 Request processed in 161us (9817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403421.413290:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789403421.415565:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050794112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789403421.418312:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789403421.418358:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789403421.418499:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050794240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403421.418575:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.418615:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403421.418699:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794240 00000100:00100000:2.0:1789403421.418707:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794240 00000100:00100000:2.0:1789403421.418748:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789403421.418757:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050794240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403421.418936:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050794240:12345-0@lo:502:mount.lustre.0 Request processed in 179us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.418953:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789403421.419094:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050794240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789403421.419148:0:18726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789403421.419157:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789403421.420151:0:18753:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789403421.420166:0:18753:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a281874d40) 00000020:00000080:0.0:1789403421.420186:0:18753:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789403421.420259:0:18753:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a2702b7000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789403421.420262:0:18753:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a2702b7000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789403421.420265:0:18753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a2702b7000 3 00010000:00080000:0.0:1789403421.420289:0:18753:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a143333800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403421.422768:0:18753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789403421.423093:0:18753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789403421.423137:0:18753:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789403421.423148:0:18753:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5fb08b1e5b761f22 00000100:00080000:0.0:1789403421.423157:0:18753:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403421.423169:0:18753:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a143333800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403421.423203:0:18753:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a14418fb80 x1876325050794368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403421.423245:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050794368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403421.423323:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403421.423384:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794368 00000100:00100000:0.0:1789403421.423406:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794368 00000100:00100000:0.0:1789403421.423434:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403421.423440:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050794368:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789403421.423474:0:17224:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1789403421.423500:0:17224:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb08b1e5b761f29 00000004:00100000:0.0:1789403421.423513:0:17224:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789403421.423540:0:17224:0:(import.c:65:import_set_state_nolock()) ffff90a1442c2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403421.423596:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876325050794368:12345-0@lo:38:llog_process_th.0 Request processed in 154us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403421.423604:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789403421.423626:0:18753:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789403421.423668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.423672:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403421.423675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.423678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403421.423702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.423705:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403421.423707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.423710:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1789403421.423718:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a14418fb80 x1876325050794368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403421.423728:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789403421.423733:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050794496:0@lo:400:kworker.0 00000100:00080000:2.0:1789403421.423746:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789403421.423753:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789403421.423757:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789403421.423759:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143333800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789403421.423760:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.423764:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050794368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403421.424802:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403421.424815:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050794880:0@lo:400:kworker.0 00000100:00100000:0.0:1789403421.424854:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.424905:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794880 00000100:00100000:0.0:1789403421.424906:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050794624:0@lo:400:kworker.0 00000100:00100000:2.0:1789403421.424910:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794880 00000100:00100000:0.0:1789403421.424944:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.424946:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403421.424953:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050794880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403421.424961:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403421.424966:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050794752:0@lo:400:kworker.0 00000100:00100000:0.0:1789403421.424987:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.424997:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050794880:12345-0@lo:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.425003:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403421.425017:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794624 00000100:00100000:0.0:1789403421.425017:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794496 00000100:00100000:2.0:1789403421.425020:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794624 00000100:00100000:0.0:1789403421.425020:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794496 00000100:00100000:2.0:1789403421.425047:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403421.425049:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050794752 00000100:00100000:0.0:1789403421.425051:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050794752 00000100:00100000:2.0:1789403421.425053:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050794624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403421.425064:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789403421.425069:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050794496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403421.425084:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050794624:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.425090:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403421.425097:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050794496:12345-0@lo:400:kworker.0 Request processed in 28us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403421.425102:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789403421.425113:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403421.425119:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050794752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403421.425144:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050794752:12345-0@lo:400:kworker.0 Request processed in 26us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403421.425149:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403421.425181:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050794752:0@lo:400:kworker.0 00010000:00080000:0.0:1789403421.425191:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a14418e300 x1876325050794624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403421.425199:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050794624:0@lo:400:kworker.0 00010000:00080000:0.0:1789403421.425233:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a1441d9500 x1876325050794880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403421.425241:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050794880:0@lo:400:kworker.0 00000100:00100000:0.0:1789403421.425249:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050794496:0@lo:400:kworker.0 00000020:01000004:2.0:1789403421.426015:0:18753:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789403421.426041:0:18753:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90a27e00b380) 00000020:00000080:2.0:1789403421.426070:0:18753:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789403421.426145:0:18753:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a2702b7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789403421.426148:0:18753:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a2702b7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789403421.426151:0:18753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a2702b7000 3 00010000:00080000:2.0:1789403421.426178:0:18753:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a14368b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403421.428588:0:18753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789403421.428970:0:18753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789403421.429020:0:18753:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403421.429041:0:18753:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5fb08b1e5b761f37 00000100:00080000:3.0:1789403421.429052:0:18753:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403421.429063:0:18753:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90a14368b000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403421.429108:0:18753:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b6680 x1876325050795008/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403421.429136:0:18753:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789403421.429205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.429210:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403421.429212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.429215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403421.429218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.429221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403421.429224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403421.429227:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403421.429251:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050795008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403421.429315:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403421.429430:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795008 00000100:00100000:3.0:1789403421.429438:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795008 00000100:00100000:3.0:1789403421.429475:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403421.429482:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050795008:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789403421.429506:0:17226:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1789403421.429545:0:17226:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5fb08b1e5b761f3e 00000004:00100000:3.0:1789403421.429560:0:17226:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789403421.429909:0:17226:0:(import.c:65:import_set_state_nolock()) ffff90a1425ab800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403421.429969:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876325050795008:12345-0@lo:38:llog_process_th.0 Request processed in 486us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403421.429977:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789403421.430907:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a1442b6680 x1876325050795008/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403421.430918:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403421.430927:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789403421.430933:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789403421.430938:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789403421.430940:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14368b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789403421.430946:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050795008:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789403421.432658:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789403421.432857:0:18726:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789403421.432888:0:18726:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403421.432905:0:18726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.432916:0:18726:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789403421.432971:0:18726:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789403421.432973:0:18726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403421.432974:0:18726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403421.432976:0:18726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403421.432977:0:18726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403421.432979:0:18726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403421.432980:0:18726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403421.432981:0:18726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403421.432983:0:18726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403421.432986:0:18726:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789403421.432988:0:18726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403421.432989:0:18726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403421.432991:0:18726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403421.432992:0:18726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403421.432993:0:18726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403421.432994:0:18726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403421.432995:0:18726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403421.432996:0:18726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403421.432997:0:18726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403421.433023:0:18726:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789403421.433054:0:18726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050795136:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789403421.433119:0:18726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.433152:0:18726:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da600 going to sleep for 11 seconds 00000100:00100000:0.0:1789403421.434070:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795136 00000100:00100000:0.0:1789403421.434080:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795136 00000100:00100000:0.0:1789403421.434128:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789403421.434138:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050795136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789403421.434165:0:17217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789403421.434179:0:17217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789403421.438474:0:17217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789403421.438488:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789403421.438505:0:17240:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789403421.438510:0:17240:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789403421.438531:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.438550:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.438557:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.438564:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.438613:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.438627:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 21 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403421.438640:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050795264:0@lo:104: 00000100:00100000:3.0:1789403421.438701:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403421.438798:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403421.438806:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 21 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403421.438978:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050795392:0@lo:104: 00000100:00100000:3.0:1789403421.439008:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403421.439110:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cd2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403421.439157:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:18726:x1876325050795136:12345-0@lo:253:mount.lustre.0 Request processed in 5019us (6036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403421.439168:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789403421.439218:0:18726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:18726:1876325050795136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403421.439229:0:18726:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789403421.439232:0:18726:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403421.439233:0:18726:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789403421.439235:0:18726:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403421.439236:0:18726:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403421.439238:0:18726:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403421.439239:0:18726:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403421.439240:0:18726:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403421.439241:0:18726:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403421.439243:0:18726:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789403421.439255:0:18726:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789403421.440107:0:17207:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789403421.440123:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795264 00000100:00100000:2.0:1789403421.440129:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795264 00000100:00100000:2.0:1789403421.440158:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795392 00000100:00100000:2.0:1789403421.440160:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795392 00000100:00100000:2.0:1789403421.440171:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403421.440179:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:17240:x1876325050795264:12345-0@lo:104: 00010000:00010000:2.0:1789403421.440193:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440302:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403421.440308:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:17240:x1876325050795264:12345-0@lo:104: Request processed in 130us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.440314:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403421.440330:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403421.440336:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26d1bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050795392:12345-0@lo:104: 00010000:00010000:2.0:1789403421.440343:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440399:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789403421.440405:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26d1bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050795392:12345-0@lo:104: Request processed in 70us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.440421:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789403421.440422:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403421.440428:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.440435:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403421.440439:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.440447:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440453:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789403421.440454:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440458:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403421.440460:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403421.440464:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403421.440467:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440474:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403421.440480:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403421.440485:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403421.440488:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.440494:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403421.440495:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440499:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403421.440511:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440512:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440520:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c6200/0x5fb08b1e5b761e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e8f expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.440527:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04a00/0x5fb08b1e5b761e96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761e9d expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403421.440532:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403421.440533:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403421.440535:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403421.440538:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403421.440539:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403421.440541:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403421.440546:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050795648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403421.440556:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050795520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403421.440676:0:17208:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1789403421.440723:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.440767:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795520 00000100:00100000:1.0:1789403421.440772:0:17210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795520 00010000:00010000:1.0:1789403421.440791:0:17210:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 21 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403421.440813:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403421.440969:0:17210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3627:x1876325050795520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403421.440979:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403421.440984:0:17210:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 21 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.440996:0:17210:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 21 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.441010:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403421.441061:0:17210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3627:x1876325050795520:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403421.441067:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789403421.441424:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761e9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761e96 expref: 20 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403421.441441:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050795264:0@lo:104: 00000100:00100000:3.0:1789403421.441456:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050795392:0@lo:104: 00010000:00010000:3.0:1789403421.441475:0:17240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403421.441643:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050795520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403421.442003:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403421.442107:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795648 00000100:00100000:1.0:1789403421.442113:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795648 00010000:00010000:1.0:1789403421.442134:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 20 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403421.442165:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403421.442172:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:3628:x1876325050795648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403421.442182:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403421.442187:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 20 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442195:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 20 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442285:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947c00/0x5fb08b1e5b761e8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761e88 expref: 20 pid: 17217 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442297:0:17979:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442306:0:17979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789403421.442319:0:17979:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005843417s 00010000:00010000:1.0:1789403421.442324:0:17979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442331:0:17979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442338:0:17979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442346:0:17979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442352:0:17979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403421.442356:0:17979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442363:0:17979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442405:0:17979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403421.442422:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403421.442466:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3628:x1876325050795648:12345-0@lo:103:ldlm_bl.0 Request processed in 295us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403421.442474:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403421.442528:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050795648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403421.442616:0:17240:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.442625:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403421.442631:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259946800/0x5fb08b1e5b761f45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789403421.444090:0:18726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789403421.446802:0:18726:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789403421.446812:0:18726:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789403421.446916:0:18726:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789403421.446971:0:18726:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789403421.446993:0:18726:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789403421.447019:0:18726:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789403421.451538:0:18726:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403421.451740:0:18726:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403421.940965:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403421.941069:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403421.941090:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050795776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403421.941168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.941286:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795776 00000100:00100000:2.0:1789403421.941294:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795776 00000100:00100000:2.0:1789403421.941347:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403421.941356:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050795776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403421.941416:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403421.941503:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050795904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403421.941533:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403421.941638:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050795776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 283us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.941646:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403421.941661:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050795904 00000100:00100000:2.0:1789403421.941664:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050795904 00000100:00100000:2.0:1789403421.941679:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789403421.941683:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050795904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403421.941699:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789403421.941728:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050795904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403421.941733:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789403421.941795:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050795776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403421.941822:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050795904:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1789403422.208371:0:18805:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403422.208740:0:18805:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789403422.451571:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403422.451578:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b17800 from 9 10000000:01000000:1.0:1789403422.451584:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403422.451628:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.451639:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.451651:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403422.451677:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403422.452328:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403422.452433:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403422.463344:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796032 00000100:00100000:2.0:1789403422.463360:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796032 00000100:00100000:2.0:1789403422.463487:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789403422.463513:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:17221:x1876325050796032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403422.463530:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403422.463550:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761f4c expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403422.463577:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 20 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403422.463597:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 20 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403422.463605:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7400, rc 0) 00000100:00100000:2.0:1789403422.463685:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:17221:x1876325050796032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (11357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403422.463692:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789403422.476182:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403422.476472:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.476486:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403422.476556:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403422.476614:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403422.476654:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403422.476674:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796160 00000100:00100000:1.0:1789403422.476680:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796160 00000100:00100000:1.0:1789403422.476718:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789403422.476725:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:17221:x1876325050796160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403422.476744:0:17217:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403422.476758:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403422.476761:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789403422.476838:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:17221:x1876325050796160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403422.476845:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789403422.476881:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789403422.476932:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403422.476941:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.476958:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403422.476968:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403422.476970:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a14452d000 from 9 10000000:01000000:1.0:1789403422.476973:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403422.476993:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477001:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477010:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403422.477035:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403422.477058:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403422.477071:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403422.477082:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796288 00000100:00100000:1.0:1789403422.477085:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796288 00000100:00100000:1.0:1789403422.477103:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403422.477109:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:17221:x1876325050796288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403422.477117:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403422.477464:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761f5a expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477486:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477504:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477512:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05600, rc 0) 00000100:00100000:1.0:1789403422.477542:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050796288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 432us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403422.477548:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789403422.477580:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403422.477591:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477600:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403422.477640:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403422.477669:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403422.477689:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403422.477702:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796416 00000100:00100000:1.0:1789403422.477706:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796416 00000100:00100000:1.0:1789403422.477728:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403422.477734:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050796416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403422.477743:0:17217:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403422.477754:0:17217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403422.477757:0:17217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789403422.477810:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050796416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403422.477824:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403422.477850:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050796416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789403422.477886:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403422.477891:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403422.477899:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403422.961752:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403423.988659:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403425.009689:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403425.335293:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789403426.034163:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403426.545797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403426.545803:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403426.545807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403426.545810:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403426.545823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403426.545825:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403426.545827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403426.545829:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789403426.545863:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050796928:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.545935:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546000:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789403426.546008:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050796544:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546039:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546060:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050797056:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546083:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546109:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050796672:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546130:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546142:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050797184:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546165:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546181:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789403426.546187:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050796800:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546204:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546219:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050797312:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546243:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403426.546267:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796928 00000100:00100000:3.0:1789403426.546274:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796928 00000100:00100000:3.0:1789403426.546303:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796672 00000100:00100000:3.0:1789403426.546305:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796672 00000100:00100000:3.0:1789403426.546319:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403426.546326:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050796928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546370:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050796928:12345-0@lo:400:kworker.0 Request processed in 44us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403426.546377:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403426.546411:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403426.546417:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050796672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546451:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050796672:12345-0@lo:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403426.546457:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403426.546471:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797056 00000100:00100000:3.0:1789403426.546474:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797056 00000100:00100000:3.0:1789403426.546502:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797184 00000100:00100000:3.0:1789403426.546504:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797184 00000100:00100000:3.0:1789403426.546527:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796800 00000100:00100000:3.0:1789403426.546529:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796800 00000100:00100000:3.0:1789403426.546537:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797312 00000100:00100000:3.0:1789403426.546539:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797312 00000100:00100000:3.0:1789403426.546551:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403426.546556:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050797056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546580:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050797056:12345-0@lo:400:kworker.0 Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403426.546586:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403426.546595:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403426.546599:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050797184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546617:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050797184:12345-0@lo:400:kworker.0 Request processed in 18us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403426.546622:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403426.546630:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403426.546634:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050796800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546651:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050796800:12345-0@lo:400:kworker.0 Request processed in 17us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403426.546656:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403426.546664:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403426.546675:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050797312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546696:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050797312:12345-0@lo:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403426.546701:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789403426.546794:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442b4000 x1876325050796800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403426.546808:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050796800:0@lo:400:kworker.0 00010000:00080000:3.0:1789403426.546817:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442b6680 x1876325050797312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403426.546825:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050797312:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546832:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050796672:0@lo:400:kworker.0 00010000:00080000:3.0:1789403426.546840:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442b4700 x1876325050797184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403426.546847:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050797184:0@lo:400:kworker.0 00010000:00080000:3.0:1789403426.546873:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442b6d80 x1876325050797056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403426.546881:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050797056:0@lo:400:kworker.0 00000100:00100000:3.0:1789403426.546888:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050796928:0@lo:400:kworker.0 00000100:00080000:2.0:1789403426.547051:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403426.547055:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789403426.547066:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050796544 00000100:00100000:1.0:1789403426.547071:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050796544 00000100:00100000:1.0:1789403426.547097:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403426.547104:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3626:x1876325050796544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403426.547149:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3626:x1876325050796544:12345-0@lo:400:kworker.0 Request processed in 45us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403426.547155:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789403426.547191:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050796544:0@lo:400:kworker.0 00000001:02000400:2.0:1789403426.905730:0:19095:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789403427.057504:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050797440:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403427.057509:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403427.057568:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403427.057615:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797440 00000100:00100000:3.0:1789403427.057621:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797440 00000100:00100000:3.0:1789403427.057671:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789403427.057678:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050797440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403427.057721:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789403427.057765:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050797440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403427.057771:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789403427.057824:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050797440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403427.058063:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050797568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403427.058093:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403427.058124:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797568 00000100:00100000:1.0:1789403427.058128:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797568 00000100:00100000:1.0:1789403427.058145:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403427.058150:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050797568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403427.058168:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789403427.058215:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050797568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403427.058230:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403427.058261:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050797568:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1789403427.728934:0:19147:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403427.729238:0:19147:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789403428.083429:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403428.084714:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789403428.629823:0:19197:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403428.630297:0:19197:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789403429.105526:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403430.130532:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403431.153591:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403431.665496:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403416/real 1789403416] req@ffff90a144180700 x1876325050790528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403431.665529:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144180700 x1876325050790528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403431.665540:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665549:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403431.665555:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665560:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403431.665565:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403416/real 1789403416] req@ffff90a144183100 x1876325050790656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403431.665583:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144183100 x1876325050790656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403431.665589:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665594:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403431.665597:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665599:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403431.665606:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403431.665622:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:3.0:1789403431.665626:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789403431.665627:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050790528:0@lo:8:kworker.0 00000100:00080000:3.0:1789403431.665633:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403431.665637:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403431.665638:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403431.665647:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789403431.665651:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050790656:0@lo:8:kworker.0 00000100:00080000:3.0:1789403431.665656:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403431.665660:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665670:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789403431.665673:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403431.665679:0:17331:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1789403431.665685:0:17331:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789403431.665697:0:17331:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a26d2d3000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403431.665720:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144465500 x1876325050798592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403431.665741:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665745:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403431.665747:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403431.665749:0:17331:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1789403431.665752:0:17331:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789403431.665758:0:17331:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a141b05800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403431.665769:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144466a00 x1876325050798720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403431.665782:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665785:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403431.665787:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403431.665790:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403431.665801:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050798592:0@lo:8:kworker.0 00000100:00100000:3.0:1789403431.665808:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050797696:0@lo:400:kworker.0 00000100:00100000:0.0:1789403431.665871:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403431.665872:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403431.665917:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050798208:0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.665945:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403431.665968:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798592 00000100:00100000:1.0:1789403431.665976:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798592 00000100:00100000:1.0:1789403431.666011:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403431.666019:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050798592:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789403431.666047:0:18731:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:1.0:1789403431.666075:0:18731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b761f68 00002000:00100000:1.0:1789403431.666089:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90a27a748800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789403431.666094:0:18731:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789403431.666097:0:18731:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789403431.666299:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789403431.666339:0:18731:0:(import.c:65:import_set_state_nolock()) ffff90a27a748000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403431.666419:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050798592:12345-0@lo:8:kworker.0 Request processed in 370us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403431.666427:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403431.666430:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789403431.666441:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050797824:0@lo:400:kworker.0 00000100:00100000:1.0:1789403431.666452:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797696 00000100:00100000:1.0:1789403431.666457:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797696 00000100:00100000:3.0:1789403431.666473:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403431.666490:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789403431.666498:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3628:x1876325050797696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403431.666530:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3628:x1876325050797696:12345-0@lo:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403431.666536:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789403431.666545:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050798336:0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.666573:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403431.666605:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050797696:0@lo:400:kworker.0 00000100:00100000:1.0:1789403431.666607:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798208 00000100:00100000:1.0:1789403431.666619:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798208 00000100:00100000:3.0:1789403431.666634:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050797952:0@lo:400:kworker.0 00000100:00100000:1.0:1789403431.666648:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798336 00000100:00100000:1.0:1789403431.666652:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798336 00000100:00100000:3.0:1789403431.666661:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403431.666676:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050798464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403431.666680:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797952 00000100:00100000:1.0:1789403431.666684:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797952 00000100:00100000:3.0:1789403431.666705:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403431.666707:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403431.666716:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050798208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.666721:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403431.666729:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050798080:0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.666759:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403431.666765:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050798208:12345-0@lo:400:kworker.0 Request processed in 50us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403431.666774:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403431.666789:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798464 00000100:00100000:1.0:1789403431.666792:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798464 00000100:00100000:3.0:1789403431.666803:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403431.666812:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050798336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403431.666815:0:17225:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789403431.666824:0:17225:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1789403431.666841:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789403431.666846:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403431.666847:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050798336:12345-0@lo:400:kworker.0 Request processed in 36us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.666855:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403431.666870:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403431.666876:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050797952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.666911:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050797952:12345-0@lo:400:kworker.0 Request processed in 36us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.666917:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403431.666928:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403431.666933:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050798464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.666978:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050798464:12345-0@lo:400:kworker.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.666985:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403431.667005:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050797824 00000100:00100000:3.0:1789403431.667008:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050797824 00010000:00080000:1.0:1789403431.667028:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144465f80 x1876325050797952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403431.667029:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798080 00000100:00100000:3.0:1789403431.667033:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798080 00000100:00100000:1.0:1789403431.667044:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050797952:0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.667051:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403431.667059:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050797824:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789403431.667065:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144466680 x1876325050798464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403431.667075:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050798464:0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.667312:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050797824:12345-0@lo:400:kworker.0 Request processed in 35us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.667319:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403431.667334:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403431.667341:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050798080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403431.667373:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050798080:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.667378:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403431.667800:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050797824:0@lo:400:kworker.0 00010000:00080000:3.0:1789403431.667812:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144467100 x1876325050798336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403431.667821:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050798336:0@lo:400:kworker.0 00010000:00080000:3.0:1789403431.667831:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144465880 x1876325050798208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403431.667838:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050798208:0@lo:400:kworker.0 00010000:00080000:0.0:1789403431.668345:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144465500 x1876325050798592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403431.668356:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403431.668363:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789403431.668372:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789403431.668377:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789403431.668379:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789403431.668408:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789403431.668414:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050798592:0@lo:8:kworker.0 00000100:00100000:0.0:1789403431.668423:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050798720:0@lo:8:kworker.0 00000100:00100000:0.0:1789403431.668466:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789403431.669226:0:17966:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789403431.669246:0:17966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17966:1876325050798976:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789403431.669266:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050798848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403431.669282:0:17966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403431.669314:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403431.669315:0:17966:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a144541480 going to sleep for 11 seconds 00000004:00080000:3.0:1789403431.669359:0:17965:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789403431.669659:0:17965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 477668268796ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789403431.669665:0:17965:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789403431.669740:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798720 00000100:00100000:3.0:1789403431.669747:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798720 00000100:00100000:3.0:1789403431.669772:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798976 00000100:00100000:3.0:1789403431.669775:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798976 00000100:00100000:3.0:1789403431.669804:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403431.669810:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3625:x1876325050798720:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789403431.669829:0:18733:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789403431.670028:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050798848 00000100:00100000:1.0:1789403431.670033:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050798848 00000100:00100000:1.0:1789403431.670065:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403431.670073:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3627:x1876325050798848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403431.670099:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789403431.670148:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3627:x1876325050798848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403431.670161:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789403431.670183:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403431.670221:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050798080:0@lo:400:kworker.0 00010000:00080000:0.0:1789403431.670258:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1443e6680 x1876325050798848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403431.670274:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050798848:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1789403431.677056:0:17957:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789403431.682030:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3625:x1876325050798720:12345-0@lo:8:kworker.0 Request processed in 12209us (13553us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789403431.682043:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789403431.682064:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403431.682069:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789403431.682073:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050798720:0@lo:8:kworker.0 00000100:00100000:3.0:1789403431.682074:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403431.682086:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17966:x1876325050798976:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1789403431.684380:0:18733:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789403431.684405:0:18733:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789403431.684482:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17966:x1876325050798976:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2397us (15197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.684492:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789403431.686110:0:17966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1443e4000 x1876325050798976/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403447 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403431.686128:0:17966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17966:1876325050798976:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789403431.686156:0:17966:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789403431.686199:0:17966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17966:1876325050799104:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789403431.686258:0:17966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403431.686295:0:17966:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a144541480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403431.686385:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799104 00000100:00100000:3.0:1789403431.686407:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799104 00000100:00100000:3.0:1789403431.686452:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403431.686462:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17966:x1876325050799104:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789403431.686487:0:18731:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789403431.686532:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17966:x1876325050799104:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403431.686539:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789403431.686588:0:17966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1443e4000 x1876325050799104/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403447 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403431.686598:0:17966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17966:1876325050799104:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789403431.686606:0:17966:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789403431.686629:0:17966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17966:1876325050799232:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789403431.686648:0:17966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403431.686660:0:17966:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a144541480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403431.686760:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799232 00000100:00100000:3.0:1789403431.686771:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799232 00000100:00100000:3.0:1789403431.686801:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403431.686807:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17966:x1876325050799232:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789403431.686833:0:18733:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1789403431.717708:0:18727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789403431.717724:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789403431.717986:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17966:x1876325050799232:12345-0@lo:5:osp-pre-0-1.0 Request processed in 31174us (31332us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789403431.718000:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789403431.718120:0:17966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1443e4000 x1876325050799232/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403447 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403431.718182:0:17966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789403431.718188:0:17966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17966:1876325050799232:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789403431.718204:0:17966:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789403431.718250:0:17966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441db100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17966:1876325050799360:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789403431.718280:0:17966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403431.718419:0:17966:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf840 going to sleep for 11 seconds 00000100:00100000:2.0:1789403431.720569:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799360 00000100:00100000:2.0:1789403431.720582:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799360 00000100:00100000:2.0:1789403431.720631:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403431.720641:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17966:x1876325050799360:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789403431.720844:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17966:x1876325050799360:12345-0@lo:900:osp-pre-0-1.0 Request processed in 204us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403431.720853:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403431.720925:0:17966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441db100 x1876325050799360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403447 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403431.720940:0:17966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441db100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17966:1876325050799360:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789403432.180932:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050799488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403432.181861:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403432.181939:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799488 00000100:00100000:1.0:1789403432.182198:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799488 00010000:00010000:0.0:1789403432.182214:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403432.182245:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789403432.182255:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050799488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403432.182287:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789403432.182336:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050799488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403432.187346:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050799616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403432.187436:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403432.187596:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050799488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403432.189320:0:17230:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789403432.189335:0:17230:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789403432.190281:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799616 00000100:00100000:0.0:1789403432.190292:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799616 00000100:00100000:2.0:1789403432.191700:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403432.191716:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050799616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403432.191758:0:19382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789403432.191838:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050799616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403432.191846:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789403432.191899:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050799616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403432.196541:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789403433.203681:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403434.225615:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789403434.775435:0:19544:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789403434.775439:0:19544:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789403434.775441:0:19544:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789403434.775556:0:19544:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a144166800 00000020:01000004:1.0:1789403434.775572:0:19544:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789403434.775587:0:19544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789403434.775600:0:19544:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a28180b380) 00000020:00000080:1.0:1789403434.775619:0:19544:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403434.834951:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789403434.836206:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789403434.836558:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789403434.837501:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789403434.837789:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789403434.838034:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789403434.838341:0:19544:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1789403434.845028:0:19544:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789403434.845351:0:19544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789403434.845365:0:19544:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789403434.845377:0:19544:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5fb08b1e5b761f76 00000020:01000004:2.0:1789403434.845384:0:19544:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789403434.845489:0:19544:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789403434.845493:0:19544:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789403434.845499:0:19544:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789403434.845527:0:19544:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789403434.845531:0:19544:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789403434.857171:0:19544:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789403434.857269:0:19544:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789403434.857274:0:19544:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789403434.857276:0:19544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403434.857277:0:19544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403434.857278:0:19544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403434.857280:0:19544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403434.857281:0:19544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403434.857282:0:19544:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403434.857284:0:19544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403434.857285:0:19544:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403434.857289:0:19544:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789403434.857291:0:19544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789403434.857292:0:19544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403434.857293:0:19544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403434.857294:0:19544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403434.857295:0:19544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403434.857296:0:19544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403434.857297:0:19544:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403434.857298:0:19544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403434.857299:0:19544:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403434.857324:0:19544:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789403434.857342:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050799744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789403434.858165:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.858275:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403434.859714:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799744 00000100:00100000:1.0:1789403434.859727:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799744 00000100:00100000:1.0:1789403434.862164:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789403434.862185:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:19544:x1876325050799744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789403434.862236:0:17217:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789403434.862244:0:17217:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789403434.862248:0:17217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789403434.864036:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:19544:x1876325050799744:12345-0@lo:253:mount.lustre.0 Request processed in 1854us (5865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403434.864050:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789403434.864486:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050799744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403434.864504:0:19544:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789403434.864507:0:19544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403434.864509:0:19544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403434.864510:0:19544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403434.864525:0:19544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403434.864526:0:19544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403434.864528:0:19544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403434.864529:0:19544:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403434.864531:0:19544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403434.864533:0:19544:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789403434.864555:0:19544:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a144166800 from lustre-OST0001 10000000:01000000:3.0:1789403434.864589:0:19544:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789403434.864592:0:19544:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789403434.864601:0:19544:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a142648000 local copy 00010000:00010000:3.0:1789403434.864611:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403434.865916:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050799872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403434.865992:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.866032:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403434.866155:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050799872 00000100:00100000:1.0:1789403434.866163:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050799872 00000100:00100000:1.0:1789403434.866218:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789403434.866228:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:19544:x1876325050799872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403434.866309:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:19544:x1876325050799872:12345-0@lo:501:mount.lustre.0 Request processed in 82us (317us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403434.866316:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789403434.866669:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050799872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789403434.866687:0:19544:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789403434.866705:0:19544:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789403434.866713:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.866725:0:19544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403434.866753:0:19544:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a144166800 10000000:01000000:3.0:1789403434.866758:0:19544:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789403434.866763:0:19544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789403434.866766:0:19544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403434.866770:0:19544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789403434.866773:0:19544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789403434.866806:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.866814:0:19544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.866823:0:19544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403434.866839:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403434.866867:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.866894:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403434.867771:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800000 00000100:00100000:1.0:1789403434.867779:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800000 00000100:00100000:1.0:1789403434.867826:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789403434.867835:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:19544:x1876325050800000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403434.867847:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403434.867861:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04400/0x5fb08b1e5b761f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761f7d expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403434.867885:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04400/0x5fb08b1e5b761f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f7d expref: 22 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403434.867895:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04400/0x5fb08b1e5b761f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f7d expref: 22 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403434.867903:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04400, rc 0) 00000100:00100000:1.0:1789403434.867962:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800000:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403434.867981:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789403434.868118:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403434.868133:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.868143:0:19544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403434.869295:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789403434.870376:0:19544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403434.873863:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789403434.873919:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789403434.873947:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789403434.873964:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789403434.873977:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789403434.873991:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789403434.874017:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789403434.874023:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789403434.874137:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403434.874207:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.874246:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403434.874438:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800128 00000100:00100000:2.0:1789403434.874445:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800128 00000100:00100000:2.0:1789403434.874491:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789403434.874500:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403434.874640:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800128:12345-0@lo:501:mount.lustre.0 Request processed in 141us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.874655:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789403434.874876:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403434.874909:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403434.874960:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.875147:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403434.875313:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800256 00000100:00100000:2.0:1789403434.875319:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800256 00000100:00100000:2.0:1789403434.875414:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789403434.875423:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403434.876145:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800256:12345-0@lo:503:mount.lustre.0 Request processed in 719us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.876154:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789403434.876363:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789403434.876861:0:19544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403434.876961:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403434.877168:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.878106:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403434.878327:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800384 00000100:00100000:2.0:1789403434.878336:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800384 00000100:00100000:2.0:1789403434.878513:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789403434.878523:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403434.879254:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800384:12345-0@lo:502:mount.lustre.0 Request processed in 730us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.879263:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789403434.879608:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403434.879903:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789403434.879944:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789403434.879959:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789403434.879973:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789403434.879986:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789403434.880000:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789403434.880014:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789403434.880028:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789403434.880111:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789403434.880149:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403434.880202:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.880283:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a250707540 going to sleep for 11 seconds 00000100:00100000:2.0:1789403434.880328:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800512 00000100:00100000:2.0:1789403434.880334:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800512 00000100:00100000:2.0:1789403434.880419:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789403434.880427:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403434.880524:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800512:12345-0@lo:502:mount.lustre.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.880532:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789403434.880607:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403434.880655:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789403434.880662:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789403434.881377:0:19548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789403434.881385:0:19548:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789403434.881425:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403434.881427:0:19548:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789403434.881432:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403434.881447:0:19548:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a2606599c0) 00000020:00000080:0.0:1789403434.881470:0:19548:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789403434.881476:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789403434.881560:0:19548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144166800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789403434.881569:0:19548:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789403434.881581:0:19548:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5fb08b1e5b761f92 00010000:00010000:0.0:1789403434.884687:0:19548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789403434.886125:0:19548:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1789403434.887526:0:19548:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789403434.888969:0:19548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789403434.888979:0:19548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403434.888985:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403434.888988:0:19548:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789403434.888991:0:19548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403434.888995:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403434.888996:0:19548:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789403434.889000:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789403434.889001:0:19548:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789403434.889003:0:19548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403434.889005:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403434.889006:0:19548:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789403434.889008:0:19548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403434.889010:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403434.889011:0:19548:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789403434.889015:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789403434.889037:0:19548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403434.889104:0:19548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403434.889106:0:19548:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789403434.889110:0:19548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789403434.889264:0:19544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789403434.889291:0:19544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789403434.889344:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.889367:0:19544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403434.889375:0:19544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144166800 from 1 10000000:01000000:2.0:1789403434.889378:0:19544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403434.889435:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.889443:0:19544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.889454:0:19544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403434.889477:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403434.889535:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.889575:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.889648:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800640 00000100:00100000:0.0:1789403434.889655:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800640 00000100:00100000:0.0:1789403434.889699:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789403434.889708:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:19544:x1876325050800640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403434.889719:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403434.889730:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761f99 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.889763:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.889773:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.889782:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8200, rc 0) 00000100:00100000:0.0:1789403434.889817:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050800640:12345-0@lo:101:mount.lustre.0 Request processed in 110us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.889824:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789403434.889977:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403434.889992:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.890001:0:19544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403434.891282:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789403434.891571:0:19544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403434.892337:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789403434.892365:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789403434.892421:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789403434.892427:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789403434.892503:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403434.892555:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.892592:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403434.893162:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800768 00000100:00100000:3.0:1789403434.893171:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800768 00000100:00100000:3.0:1789403434.893219:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789403434.893228:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050800768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403434.893336:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050800768:12345-0@lo:501:mount.lustre.0 Request processed in 108us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.893342:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789403434.893751:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403434.893793:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403434.893836:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.895046:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403434.900649:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050800896 00000100:00100000:3.0:1789403434.900664:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050800896 00000100:00100000:3.0:1789403434.900725:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789403434.900737:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050800896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403434.900906:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050800896:12345-0@lo:503:mount.lustre.0 Request processed in 171us (7067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.900914:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789403434.901165:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050800896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789403434.901574:0:19544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403434.901648:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403434.901696:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.901725:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a6200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.902025:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801024 00000100:00100000:0.0:1789403434.902031:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801024 00000100:00100000:0.0:1789403434.902083:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789403434.902091:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050801024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403434.902188:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050801024:12345-0@lo:502:mount.lustre.0 Request processed in 98us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.902196:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789403434.903153:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403434.903557:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789403434.903585:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789403434.903597:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789403434.903608:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789403434.903645:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789403434.903663:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789403434.903677:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789403434.904262:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789403434.904289:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789403434.904303:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789403434.904316:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789403434.904354:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403434.904453:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.904494:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403434.904500:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801152 00000100:00100000:3.0:1789403434.904509:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801152 00000100:00100000:3.0:1789403434.904564:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789403434.904575:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050801152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403434.904692:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050801152:12345-0@lo:502:mount.lustre.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.904699:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403434.904914:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403434.904977:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789403434.904985:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789403434.905755:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403434.905764:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905767:0:19552:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789403434.905775:0:19552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a144166800 00000020:00000080:2.0:1789403434.905778:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403434.905785:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403434.905788:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905789:0:19552:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789403434.905792:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403434.905795:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905796:0:19552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789403434.905800:0:19552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a144166800 00000020:00000080:2.0:1789403434.905802:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403434.905858:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403434.905861:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905862:0:19552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789403434.905865:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403434.905867:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905868:0:19552:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789403434.905872:0:19552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a144166800 00000020:00000080:2.0:1789403434.905874:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403434.905891:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403434.905895:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905896:0:19552:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789403434.905899:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403434.905901:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905902:0:19552:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789403434.905913:0:19552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a144166800 00000020:00000080:2.0:1789403434.905915:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403434.905950:0:19552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403434.905953:0:19552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403434.905955:0:19552:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789403434.905958:0:19552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789403434.914836:0:19544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789403434.914886:0:19544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403434.914910:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.914924:0:19544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403434.914995:0:19544:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789403434.914999:0:19544:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a144166800 10000000:01000000:3.0:1789403434.915002:0:19544:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a144166800 10000000:01000000:3.0:1789403434.915006:0:19544:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403434.915011:0:19544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a144166800 from 1 10000000:01000000:3.0:1789403434.915013:0:19544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403434.915047:0:19544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.915055:0:19544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.915066:0:19544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403434.915102:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403434.915168:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.915202:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.915509:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801280 00000100:00100000:0.0:1789403434.915517:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801280 00000100:00100000:0.0:1789403434.915560:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789403434.915569:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:19544:x1876325050801280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403434.915582:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403434.915595:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e9c00/0x5fb08b1e5b761fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761fa7 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.915618:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e9c00/0x5fb08b1e5b761fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761fa7 expref: 24 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.915640:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e9c00/0x5fb08b1e5b761fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761fa7 expref: 24 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.915649:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9c00, rc 0) 00000100:00100000:0.0:1789403434.915690:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801280:12345-0@lo:101:mount.lustre.0 Request processed in 122us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.915696:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789403434.915795:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403434.915809:0:19544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403434.915818:0:19544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403434.917070:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789403434.917331:0:19544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403434.917538:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789403434.917562:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789403434.917574:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789403434.917585:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789403434.917596:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789403434.917609:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789403434.917621:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789403434.917634:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789403434.918360:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789403434.918377:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789403434.918736:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789403434.918771:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789403434.918788:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789403434.918802:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789403434.918816:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789403434.918830:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789403434.918843:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789403434.918869:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789403434.918884:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789403434.918897:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789403434.918910:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789403434.918922:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789403434.918948:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789403434.918963:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789403434.918977:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789403434.918990:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789403434.919004:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789403434.919033:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789403434.919048:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789403434.919060:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789403434.919073:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789403434.919087:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789403434.919101:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789403434.919113:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789403434.919127:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789403434.919141:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789403434.919151:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789403434.919163:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789403434.919176:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789403434.919189:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789403434.919203:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789403434.919215:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789403434.919228:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789403434.919255:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789403434.919273:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789403434.919286:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789403434.919309:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789403434.919314:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789403434.919438:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403434.919507:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.919550:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.922953:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801408 00000100:00100000:0.0:1789403434.922968:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801408 00000100:00100000:0.0:1789403434.923062:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789403434.923073:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403434.923236:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801408:12345-0@lo:501:mount.lustre.0 Request processed in 164us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.923244:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789403434.923361:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403434.923433:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403434.923478:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.923507:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.923571:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801536 00000100:00100000:0.0:1789403434.923576:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801536 00000100:00100000:0.0:1789403434.923598:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789403434.923604:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403434.923687:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801536:12345-0@lo:503:mount.lustre.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.923693:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789403434.923821:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789403434.924201:0:19544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403434.924265:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403434.924307:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.924339:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.926813:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801664 00000100:00100000:0.0:1789403434.926828:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801664 00000100:00100000:0.0:1789403434.926877:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789403434.926886:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403434.927039:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801664:12345-0@lo:502:mount.lustre.0 Request processed in 154us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.927053:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789403434.927157:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403434.927363:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789403434.929000:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789403434.929041:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789403434.929058:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789403434.929072:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789403434.929087:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789403434.929101:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789403434.929116:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789403434.929128:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789403434.929140:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789403434.929170:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789403434.929187:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789403434.929199:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789403434.929213:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789403434.929226:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789403434.929251:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789403434.929264:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789403434.929279:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789403434.929293:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789403434.929307:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789403434.929323:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789403434.929337:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789403434.929351:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789403434.929373:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789403434.929384:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789403434.929418:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789403434.929442:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789403434.929455:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789403434.929466:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789403434.929477:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789403434.929489:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789403434.929500:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789403434.929512:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789403434.929524:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789403434.929537:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789403434.929550:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789403434.929561:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789403434.929575:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789403434.929589:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789403434.929602:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789403434.929614:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789403434.929626:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789403434.933382:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789403434.933435:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789403434.933449:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789403434.933461:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789403434.933473:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789403434.933485:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789403434.933549:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403434.933619:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.933660:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801792 00000100:00100000:3.0:1789403434.933667:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801792 00000100:00100000:3.0:1789403434.933712:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789403434.933721:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403434.933823:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801792:12345-0@lo:502:mount.lustre.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.933831:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789403434.933883:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789403434.933904:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403434.934318:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1789403434.934343:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1789403434.934369:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403434.934436:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.934451:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d22a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.937485:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050801920 00000100:00100000:0.0:1789403434.937496:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050801920 00000100:00100000:0.0:1789403434.937541:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789403434.937550:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403434.937710:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050801920:12345-0@lo:502:mount.lustre.0 Request processed in 160us (3273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.937717:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789403434.938777:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050801920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403434.938868:0:19544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789403434.938882:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789403434.943070:0:19557:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789403434.943088:0:19557:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a281808000) 00000020:00000080:1.0:1789403434.943113:0:19557:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789403434.943191:0:19557:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144166800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789403434.943195:0:19557:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a144166800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789403434.943197:0:19557:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a144166800 3 00010000:00080000:1.0:1789403434.943236:0:19557:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1434d4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403434.945863:0:19557:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1789403434.946115:0:19557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789403434.946162:0:19557:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789403434.946174:0:19557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5fb08b1e5b761fbc 00000100:00080000:0.0:1789403434.946184:0:19557:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403434.946195:0:19557:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a1434d4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403434.946228:0:19557:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1441db100 x1876325050802048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403434.946257:0:19557:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789403434.946303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403434.946307:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403434.946310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403434.946313:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403434.946339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403434.946343:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789403434.946345:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403434.946356:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1789403434.946360:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789403434.946365:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a141b05800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403434.946379:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1441d8380 x1876325050802688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403434.946449:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050802176:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946505:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.946534:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050802816:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946555:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.946572:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789403434.946578:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050802304:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946595:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.946607:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050802944:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946623:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.946852:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050802432:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946878:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.946896:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050803072:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946916:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.946946:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403434.946951:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050802560:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.946975:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.947002:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802176 00000100:00100000:0.0:1789403434.947009:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802176 00000100:00100000:0.0:1789403434.947044:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802432 00000100:00100000:0.0:1789403434.947048:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802432 00000100:00100000:0.0:1789403434.947064:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789403434.947080:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050802176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.947133:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050802176:12345-0@lo:400:kworker.0 Request processed in 55us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.947140:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789403434.947157:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789403434.947163:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050802432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.947194:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050802432:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.947201:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789403434.947216:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802816 00000100:00100000:0.0:1789403434.947220:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802816 00000100:00100000:0.0:1789403434.947237:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802304 00000100:00100000:0.0:1789403434.947239:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802304 00000100:00100000:0.0:1789403434.947249:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802944 00000100:00100000:0.0:1789403434.947251:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802944 00000100:00100000:0.0:1789403434.947270:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803072 00000100:00100000:0.0:1789403434.947272:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803072 00000100:00100000:0.0:1789403434.947285:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789403434.947291:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050802816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403434.947959:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050802048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789403434.948002:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.948028:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050802688:0@lo:8:kworker.0 00000100:00100000:3.0:1789403434.948050:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.948081:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802048 00000100:00100000:3.0:1789403434.948086:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802048 00000100:00100000:3.0:1789403434.948103:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789403434.948120:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050802304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403434.948152:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050802304:12345-0@lo:400:kworker.0 Request processed in 34us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.948157:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789403434.948172:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403434.948176:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050802048:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789403434.948195:0:17224:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1789403434.948225:0:17224:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb08b1e5b761fc3 00000004:00100000:3.0:1789403434.948238:0:17224:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789403434.948263:0:17224:0:(import.c:65:import_set_state_nolock()) ffff90a1425ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403434.948293:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876325050802048:12345-0@lo:38:llog_process_th.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.948299:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403434.948310:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403434.948316:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050802944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403434.948337:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050802944:12345-0@lo:400:kworker.0 Request processed in 22us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.948343:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403434.948351:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403434.948357:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050803072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403434.948376:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050803072:12345-0@lo:400:kworker.0 Request processed in 20us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.948381:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403434.948414:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802560 00000100:00100000:3.0:1789403434.948418:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802560 00000100:00100000:3.0:1789403434.948447:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050802688 00000100:00100000:3.0:1789403434.948449:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050802688 00000100:00100000:3.0:1789403434.948458:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403434.948463:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050802560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403434.948491:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050802560:12345-0@lo:400:kworker.0 Request processed in 28us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.948497:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403434.948506:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789403434.948509:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050802688:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789403434.948536:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050802688:12345-0@lo:8:kworker.0 Request processed in 25us (486us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789403434.948541:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789403434.948572:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441db100 x1876325050802048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403434.948583:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403434.948591:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789403434.948597:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789403434.948601:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789403434.948604:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789403434.948609:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050802048:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789403434.948617:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403434.948619:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403434.948623:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789403434.948625:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050802688:0@lo:8:kworker.0 00000100:00100000:0.0:1789403434.948783:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050802816:12345-0@lo:400:kworker.0 Request processed in 1491us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403434.948789:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789403434.948814:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403434.948818:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403434.948820:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789403434.948837:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441d9880 x1876325050802560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403434.948847:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050802560:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.948864:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050802432:0@lo:400:kworker.0 00010000:00080000:0.0:1789403434.948873:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441d9f80 x1876325050803072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403434.948881:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050803072:0@lo:400:kworker.0 00010000:00080000:0.0:1789403434.948906:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441d8a80 x1876325050802304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403434.948914:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050802304:0@lo:400:kworker.0 00010000:00080000:0.0:1789403434.948922:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441da300 x1876325050802944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403434.949301:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050802944:0@lo:400:kworker.0 00000100:00100000:0.0:1789403434.949317:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050802176:0@lo:400:kworker.0 00010000:00080000:0.0:1789403434.949327:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1441dbb80 x1876325050802816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403434.949334:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050802816:0@lo:400:kworker.0 00000020:01000004:1.0:1789403434.957573:0:19557:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789403434.957590:0:19557:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90a28180cd40) 00000020:00000080:1.0:1789403434.957618:0:19557:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789403434.957716:0:19557:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144166800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789403434.957720:0:19557:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a144166800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789403434.957723:0:19557:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a144166800 3 00010000:00080000:1.0:1789403434.957752:0:19557:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1434d0000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403434.960900:0:19557:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789403434.961121:0:19557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789403434.961167:0:19557:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789403434.961180:0:19557:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5fb08b1e5b761fd1 00000100:00080000:1.0:1789403434.961191:0:19557:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403434.961203:0:19557:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a1434d0000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403434.961236:0:19557:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144180e00 x1876325050803200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403434.961268:0:19557:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789403434.961327:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050803200:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789403434.961426:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403434.961481:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803200 00000100:00100000:3.0:1789403434.961488:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803200 00000100:00100000:3.0:1789403434.961519:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403434.961526:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050803200:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789403434.961550:0:17224:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1789403434.961593:0:17224:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5fb08b1e5b761fd8 00000004:00100000:3.0:1789403434.961607:0:17224:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789403434.961637:0:17224:0:(import.c:65:import_set_state_nolock()) ffff90a1425ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403434.961688:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876325050803200:12345-0@lo:38:llog_process_th.0 Request processed in 161us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403434.961696:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789403434.961733:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144180e00 x1876325050803200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403434.961743:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403434.961751:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789403434.961758:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789403434.961761:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789403434.961764:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1434d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789403434.961769:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050803200:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789403434.966811:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403434.966819:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403434.966822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403434.966825:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789403434.966966:0:19557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789403434.967156:0:19544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789403434.967197:0:19544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403434.967217:0:19544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.967235:0:19544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789403434.967279:0:19544:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789403434.967281:0:19544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789403434.967283:0:19544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403434.967285:0:19544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403434.967286:0:19544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403434.967287:0:19544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403434.967288:0:19544:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403434.967290:0:19544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403434.967291:0:19544:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403434.967295:0:19544:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789403434.967297:0:19544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789403434.967298:0:19544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789403434.967299:0:19544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403434.967300:0:19544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403434.967301:0:19544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403434.967302:0:19544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403434.967303:0:19544:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403434.967304:0:19544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403434.967305:0:19544:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403434.967329:0:19544:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789403434.967346:0:19544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050803328:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789403434.967427:0:19544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.967459:0:19544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403434.967480:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803328 00000100:00100000:0.0:1789403434.967486:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803328 00000100:00100000:0.0:1789403434.967526:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789403434.967535:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050803328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789403434.967559:0:17219:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789403434.967574:0:17219:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789403434.979971:0:17219:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789403434.980067:0:17219:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789403434.980595:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:19544:x1876325050803328:12345-0@lo:253:mount.lustre.0 Request processed in 13057us (13163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403434.980620:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789403434.980728:0:19544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:41b7c44b-9a12-452a-b9e6-b5b285399ec4:19544:1876325050803328:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403434.980741:0:19544:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789403434.980744:0:19544:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403434.980746:0:19544:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403434.980754:0:19544:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403434.980755:0:19544:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403434.980756:0:19544:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403434.980757:0:19544:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403434.980759:0:19544:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403434.980760:0:19544:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403434.980762:0:19544:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789403434.980776:0:19544:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789403434.984361:0:17240:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789403434.984372:0:17240:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789403434.984452:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.984471:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 23 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.984478:0:17240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.984485:0:17240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.984527:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.984543:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 23 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403434.984556:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050803456:0@lo:104: 00000100:00100000:0.0:1789403434.984614:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403434.984960:0:17240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 23 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403434.984970:0:17240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 23 pid: 17219 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403434.984980:0:17240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050803584:0@lo:104: 00000100:00100000:0.0:1789403434.985019:0:17240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403434.987427:0:17240:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526540 going to sleep for 11 seconds 00000001:00000004:3.0:1789403434.990581:0:19544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789403434.990706:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803456 00000100:00100000:1.0:1789403434.990715:0:17208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803456 00000100:00100000:2.0:1789403434.990833:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803584 00000100:00100000:2.0:1789403434.990838:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803584 00000100:00100000:2.0:1789403434.990880:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403434.990890:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:17240:x1876325050803584:12345-0@lo:104: 00010000:00010000:2.0:1789403434.990909:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991031:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403434.991038:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:17240:x1876325050803584:12345-0@lo:104: Request processed in 150us (6019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.991045:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789403434.991068:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403434.991074:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991081:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403434.991085:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991094:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403434.991102:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403434.991121:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403434.991161:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991168:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403434.991196:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991204:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b761f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f53 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991217:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403434.991218:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403434.991221:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403434.991234:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050803712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403434.991270:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.991323:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803712 00000100:00100000:2.0:1789403434.991328:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803712 00010000:00010000:2.0:1789403434.991344:0:17211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 24 pid: 17219 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403434.991367:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403434.991373:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050803712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403434.991384:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403434.991412:0:17211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 24 pid: 17219 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991422:0:17211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 24 pid: 17219 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991445:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403434.991475:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050803712:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.991481:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403434.991518:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050803712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403434.991568:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403434.991575:0:17208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050803456:12345-0@lo:104: 00010000:00010000:2.0:1789403434.991583:0:17208:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991619:0:17208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403434.991625:0:17208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:17240:x1876325050803456:12345-0@lo:104: Request processed in 51us (7011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.991631:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789403434.991837:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403434.991843:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991849:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403434.991852:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991859:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403434.991866:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403434.991883:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403434.991900:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991905:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403434.991923:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991941:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b761f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f61 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.991957:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403434.991958:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403434.991960:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403434.991970:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050803840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403434.992005:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403434.992040:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803840 00000100:00100000:2.0:1789403434.992044:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803840 00010000:00010000:2.0:1789403434.992058:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 24 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403434.992079:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403434.992084:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3626:x1876325050803840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403434.992092:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403434.992097:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 24 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992107:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 24 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992126:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992133:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789403434.992147:0:17209:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007776308s 00010000:00010000:2.0:1789403434.992152:0:17209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992159:0:17209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992166:0:17209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992172:0:17209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992177:0:17209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403434.992181:0:17209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992279:0:17209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992290:0:17209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403434.992300:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403434.992332:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3626:x1876325050803840:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403434.992345:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403434.992377:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050803840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403434.992490:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05600/0x5fb08b1e5b761f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761f5a expref: 23 pid: 17217 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403434.992501:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050803456:0@lo:104: 00010000:00010000:1.0:1789403434.992511:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c7400/0x5fb08b1e5b761f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761f4c expref: 22 pid: 17219 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403434.992518:0:17240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17240:1876325050803584:0@lo:104: 00010000:00010000:1.0:1789403434.992531:0:17240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403434.992540:0:17240:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403434.992546:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403434.992552:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b761fdf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789403434.996539:0:19544:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789403434.996548:0:19544:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789403434.996579:0:19544:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789403434.996615:0:19544:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789403434.996631:0:19544:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789403434.996707:0:19544:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789403434.998111:0:19544:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403434.998485:0:19544:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403435.249893:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403435.574902:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789403435.853573:0:19610:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403435.853798:0:19610:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789403436.210566:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789403436.210575:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a281b17800 from 10 10000000:01000000:3.0:1789403436.210580:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403436.210628:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.210641:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.210661:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403436.210687:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050803968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403436.210749:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403436.210787:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a259988f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403436.210934:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050803968 00000100:00100000:1.0:1789403436.210941:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050803968 00000100:00100000:1.0:1789403436.211000:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789403436.211009:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050803968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403436.211026:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403436.211047:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761fe6 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403436.211072:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761fe6 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403436.211083:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761fe6 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403436.211090:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05c00, rc 0) 00000100:00100000:1.0:1789403436.211146:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050803968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403436.211153:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789403436.211264:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050803968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403436.211279:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.211287:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403436.211335:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050804096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789403436.211365:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403436.211416:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a259988f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403436.211498:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804096 00000100:00100000:1.0:1789403436.211503:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804096 00000100:00100000:1.0:1789403436.211534:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789403436.211541:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050804096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403436.211555:0:17219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403436.211570:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403436.211573:0:17219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789403436.211830:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050804096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 289us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403436.211837:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789403436.213857:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050804096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789403436.213961:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789403436.213972:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.213983:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403436.213994:0:17221:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789403436.213997:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a14452d000 from 10 10000000:01000000:3.0:1789403436.214000:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403436.214031:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.214164:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.214174:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403436.214208:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050804224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403436.214268:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403436.214450:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a259988f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403436.216798:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804224 00000100:00100000:0.0:1789403436.216813:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804224 00000100:00100000:0.0:1789403436.216878:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789403436.216888:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050804224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403436.216904:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403436.216930:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761ffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b761ff4 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403436.216957:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ff4 expref: 24 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403436.216968:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ff4 expref: 24 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403436.216977:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8400, rc 0) 00000100:00100000:0.0:1789403436.217052:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050804224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403436.217059:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789403436.217554:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050804224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403436.217573:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.217584:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403436.217660:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050804352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789403436.217699:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403436.217735:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a259988f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403436.220236:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804352 00000100:00100000:1.0:1789403436.220250:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804352 00000100:00100000:1.0:1789403436.220309:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789403436.220318:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050804352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403436.220341:0:17219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403436.220362:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403436.220368:0:17219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789403436.220517:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050804352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 200us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403436.220524:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789403436.220711:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050804352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789403436.220782:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789403436.220791:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403436.220801:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403436.288008:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403436.786063:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403436.786089:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050804480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403436.786156:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403436.786246:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804480 00000100:00100000:2.0:1789403436.786255:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804480 00000100:00100000:2.0:1789403436.786310:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789403436.786319:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050804480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403436.786346:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789403436.786414:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050804480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403436.786421:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789403436.786462:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e4a80 x1876325050804480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403436.786480:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050804480:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789403436.786541:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403437.299062:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050804608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403437.299139:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403437.299180:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403437.299187:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050804736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403437.299208:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403437.299663:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804608 00000100:00100000:1.0:1789403437.299672:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804608 00000100:00100000:1.0:1789403437.299714:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804736 00000100:00100000:1.0:1789403437.299717:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804736 00000100:00100000:1.0:1789403437.299733:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789403437.299742:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050804608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403437.299777:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789403437.299829:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050804608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403437.299836:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789403437.299853:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789403437.299860:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050804736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403437.299875:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789403437.299902:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050804736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403437.299932:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789403437.299977:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050804736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403437.299989:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050804608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403437.300989:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403438.323082:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403438.323286:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789403439.093049:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403419/real 1789403419] req@ffff90a1442b5c00 x1876325050791424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.093081:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a1442b5c00 x1876325050791424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403439 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.093091:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403419/real 1789403419] req@ffff90a1442b7480 x1876325050791552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403439 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.093103:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a1442b7480 x1876325050791552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403439 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403439.093123:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403439.093152:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789403439.093156:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050791424:0@lo:8:kworker.0 00000100:00080000:1.0:1789403439.093161:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403439.093167:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789403439.093169:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050791552:0@lo:8:kworker.0 00000100:00100000:0.0:1789403439.093332:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403439.093404:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403439.093416:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050804992:0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.093473:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.093520:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804992 00000100:00100000:1.0:1789403439.093529:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804992 00000100:00100000:1.0:1789403439.093584:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403439.093613:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050804992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.093665:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050804992:12345-0@lo:400:kworker.0 Request processed in 56us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403439.093672:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403439.093711:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050804992:0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.093775:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050804864:0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.093810:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.093892:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050804864 00000100:00100000:1.0:1789403439.093906:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050804864 00000100:00100000:1.0:1789403439.093942:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789403439.093949:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3627:x1876325050804864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.093986:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3627:x1876325050804864:12345-0@lo:400:kworker.0 Request processed in 37us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403439.093992:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789403439.094024:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050804864:0@lo:400:kworker.0 00000100:00080000:3.0:1789403439.095402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403439.095409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789403439.095412:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403439.095418:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:3.0:1789403439.095430:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789403439.095440:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a1436b1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403439.095470:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b5c00 x1876325050805120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403439.095487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403439.095490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403439.095492:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403439.095494:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:3.0:1789403439.095497:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789403439.095501:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a26d2d2000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403439.095511:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442b6d80 x1876325050805248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403439.095550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403439.095553:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403439.095554:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403439.095559:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a141b05800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403439.095568:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1441d8700 x1876325050805760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403439.096439:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050805376:0@lo:400:kworker.0 00000100:00100000:3.0:1789403439.096496:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.096529:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050806016:0@lo:400:kworker.0 00000100:00100000:3.0:1789403439.096548:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.096569:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789403439.096575:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050805504:0@lo:400:kworker.0 00000100:00100000:3.0:1789403439.096609:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.096888:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050806144:0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.096955:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050805888:0@lo:400:kworker.0 00000100:00100000:3.0:1789403439.096982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.096988:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050805120:0@lo:8:kworker.0 00000100:00100000:1.0:1789403439.097013:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.097020:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805376 00000100:00100000:3.0:1789403439.097027:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805376 00000100:00100000:1.0:1789403439.097039:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050805248:0@lo:8:kworker.0 00000100:00100000:1.0:1789403439.097056:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.097068:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806016 00000100:00100000:3.0:1789403439.097071:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806016 00000100:00100000:1.0:1789403439.097071:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050805760:0@lo:8:kworker.0 00000100:00100000:3.0:1789403439.097095:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806144 00000100:00100000:1.0:1789403439.097095:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.097097:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806144 00000100:00100000:0.0:1789403439.098736:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805120 00000100:00100000:0.0:1789403439.098748:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805120 00000100:00100000:0.0:1789403439.098771:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805248 00000100:00100000:0.0:1789403439.098774:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805248 00000100:00100000:0.0:1789403439.098781:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805760 00000100:00100000:0.0:1789403439.098784:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805760 00000100:00100000:0.0:1789403439.098795:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403439.098810:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050805120:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789403439.098841:0:18731:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1789403439.098870:0:18731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b762002 00002000:00100000:0.0:1789403439.098883:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a14242a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789403439.098886:0:18731:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789403439.098889:0:18731:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789403439.098971:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789403439.098995:0:18731:0:(import.c:65:import_set_state_nolock()) ffff90a14242d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403439.099069:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050805120:12345-0@lo:8:kworker.0 Request processed in 260us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.099076:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403439.099092:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403439.099095:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050805248:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789403439.099111:0:18731:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1789403439.099127:0:18731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b762009 00002000:00100000:0.0:1789403439.099133:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a14242a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789403439.099136:0:18731:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789403439.099138:0:18731:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789403439.099284:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789403439.099299:0:18731:0:(import.c:65:import_set_state_nolock()) ffff90a142429800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403439.099328:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050805248:12345-0@lo:8:kworker.0 Request processed in 232us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.099335:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403439.099348:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403439.099352:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050805760:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789403439.099375:0:18731:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1789403439.099413:0:18731:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b762010 00002000:00100000:0.0:1789403439.099419:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90a14242d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789403439.099422:0:18731:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789403439.099425:0:18731:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789403439.099445:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789403439.099457:0:18731:0:(import.c:65:import_set_state_nolock()) ffff90a14242e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403439.099485:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050805760:12345-0@lo:8:kworker.0 Request processed in 131us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.099491:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789403439.100166:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b5c00 x1876325050805120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.100177:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789403439.100184:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789403439.100196:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789403439.100201:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789403439.100204:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789403439.100218:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789403439.100222:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050805120:0@lo:8:kworker.0 00010000:00080000:1.0:1789403439.100235:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b6d80 x1876325050805248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.100242:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789403439.100245:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789403439.100249:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789403439.100251:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789403439.100253:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789403439.100261:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789403439.100264:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050805248:0@lo:8:kworker.0 00010000:00080000:1.0:1789403439.100272:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441d8700 x1876325050805760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403439.100280:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789403439.100283:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789403439.100286:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789403439.100287:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789403439.100296:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789403439.100298:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050805760:0@lo:8:kworker.0 00000004:00080000:1.0:1789403439.100354:0:17249:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789403439.100369:0:17249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17249:1876325050806656:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789403439.100419:0:17249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.100443:0:17249:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a53c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789403439.100456:0:17250:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789403439.100521:0:17250:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 485099131885ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789403439.100526:0:17250:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789403439.100554:0:17968:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789403439.100566:0:17968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17968:1876325050806912:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789403439.100587:0:17968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.100597:0:17968:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5000 going to sleep for 11 seconds 00000004:00080000:1.0:1789403439.100613:0:17967:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789403439.100654:0:17967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 485099264280ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789403439.100659:0:17967:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789403439.100678:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050806784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403439.100704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.100725:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403439.100730:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050806528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403439.100749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.100989:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806784 00000100:00100000:1.0:1789403439.100996:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806784 00000100:00100000:1.0:1789403439.101026:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806528 00000100:00100000:1.0:1789403439.101028:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806528 00000100:00100000:1.0:1789403439.101042:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403439.101048:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050806784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403439.101071:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403439.101072:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403439.101105:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050805376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.101112:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789403439.101115:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050806784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403439.101121:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403439.101123:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050806016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.101136:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403439.101141:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050806528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403439.101159:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050806016:12345-0@lo:400:kworker.0 Request processed in 40us (4610us total) trans 0 rc 0/0 00002000:00000024:1.0:1789403439.101161:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789403439.101165:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789403439.101181:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789403439.101186:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050806528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.101189:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050806144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.101192:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403439.101226:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050805376:12345-0@lo:400:kworker.0 Request processed in 125us (4726us total) trans 0 rc 0/0 00010000:00080000:1.0:1789403439.101226:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144465c00 x1876325050806528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403439.101233:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050806144:12345-0@lo:400:kworker.0 Request processed in 44us (4248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403439.101244:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403439.101251:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789403439.101253:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050806528:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789403439.101264:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144467100 x1876325050806784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.101275:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050806784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403439.101281:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805504 00000100:00100000:0.0:1789403439.101285:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805504 00000100:00100000:3.0:1789403439.101287:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806656 00000100:00100000:3.0:1789403439.101293:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806656 00000100:00100000:1.0:1789403439.101298:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806912 00000100:00100000:1.0:1789403439.101303:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806912 00000100:00100000:0.0:1789403439.101313:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403439.101318:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050805504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403439.101327:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789403439.101338:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17249:x1876325050806656:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789403439.101355:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050805504:12345-0@lo:400:kworker.0 Request processed in 35us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.101368:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000004:00080000:0.0:1789403439.101403:0:17248:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789403439.101452:0:17248:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 485100062128ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789403439.101457:0:17248:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789403439.101487:0:17251:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789403439.101510:0:17251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17251:1876325050807168:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789403439.101541:0:17251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789403439.101583:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403439.101588:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403439.101590:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403439.101593:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403439.103483:0:18733:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403439.103633:0:17251:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a250707e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403439.105225:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050805632:0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.105285:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.105332:0:18733:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789403439.105384:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050805504:0@lo:400:kworker.0 00010000:00080000:3.0:1789403439.105414:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441d9f80 x1876325050806144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403439.105425:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050806144:0@lo:400:kworker.0 00000100:00100000:1.0:1789403439.105438:0:18731:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00010000:00080000:3.0:1789403439.105447:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b4000 x1876325050805376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.105447:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807168 00000100:00100000:1.0:1789403439.105453:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807168 00000100:00100000:3.0:1789403439.105455:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050805376:0@lo:400:kworker.0 00010000:00080000:3.0:1789403439.105465:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441d8a80 x1876325050806016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403439.105472:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050806016:0@lo:400:kworker.0 00000100:00080000:1.0:1789403439.105511:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789403439.107552:0:17957:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1789403439.107588:0:17204:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789403439.108071:0:18732:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789403439.108080:0:18732:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789403439.108086:0:18732:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:0.0:1789403439.108382:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050806272:0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.108453:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403439.108476:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050807040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403439.108503:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403439.108544:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403439.108564:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050806400:0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.108669:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403439.108704:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806272 00000100:00100000:0.0:1789403439.108713:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806272 00000100:00100000:0.0:1789403439.108760:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805888 00000100:00100000:0.0:1789403439.108764:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805888 00000100:00100000:0.0:1789403439.108776:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050806400 00000100:00100000:0.0:1789403439.108778:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050806400 00000100:00100000:0.0:1789403439.108796:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403439.108804:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050806272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.108858:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050806272:12345-0@lo:400:kworker.0 Request processed in 54us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.108874:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403439.108892:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403439.108912:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050805888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.108955:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050805888:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.108961:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403439.108973:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789403439.108979:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050806400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.109021:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050806400:12345-0@lo:400:kworker.0 Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.109028:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789403439.109050:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403439.109054:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403439.109407:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807040 00000100:00100000:0.0:1789403439.109413:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807040 00000100:00100000:0.0:1789403439.109441:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403439.109448:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1876325050807040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403439.109463:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789403439.109497:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1876325050807040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.109503:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789403439.109549:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441da300 x1876325050805888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403439.109564:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050805888:0@lo:400:kworker.0 00010000:00080000:0.0:1789403439.109650:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441d9880 x1876325050806400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403439.109670:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050806400:0@lo:400:kworker.0 00010000:00080000:0.0:1789403439.109705:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441dad80 x1876325050806272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403439.109715:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050806272:0@lo:400:kworker.0 00010000:00080000:0.0:1789403439.109725:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251ea00 x1876325050807040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403439.109739:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050807040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403439.109761:0:18731:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403439.109768:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050805632 00000100:00100000:0.0:1789403439.109772:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050805632 00000100:00100000:0.0:1789403439.109796:0:18731:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789403439.109802:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403439.109808:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050805632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403439.109846:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050805632:12345-0@lo:400:kworker.0 Request processed in 37us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403439.109852:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789403439.109866:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789403439.109882:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441dbb80 x1876325050805632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403439.109892:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050805632:0@lo:400:kworker.0 00000004:00080000:2.0:1789403439.117047:0:17204:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789403439.117686:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403439.117702:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17968:x1876325050806912:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:2.0:1789403439.119827:0:19833:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789403439.119835:0:19833:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789403439.119935:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17968:x1876325050806912:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2235us (19343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403439.119946:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403439.119982:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403439.119992:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17251:x1876325050807168:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1789403439.120336:0:17968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144466300 x1876325050806912/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.120352:0:17968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17968:1876325050806912:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789403439.120364:0:17968:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789403439.120422:0:17968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17968:1876325050807296:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789403439.120458:0:17968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403439.120484:0:17968:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403439.120511:0:18731:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789403439.120518:0:18731:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:3.0:1789403439.121464:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.121474:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121490:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.121495:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.121501:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121517:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121526:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121533:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121558:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.121570:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.121576:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121583:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.121587:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.121596:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403439.121954:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807296 00000100:00100000:1.0:1789403439.121963:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807296 00010000:00010000:3.0:1789403439.122136:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403439.122137:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789403439.122149:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b450484/0x5fb08b1e5b762017 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403439.122151:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17968:x1876325050807296:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1789403439.122177:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.122179:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.122181:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789403439.122184:0:19834:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789403439.122616:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17968:x1876325050807296:12345-0@lo:5:osp-pre-1-1.0 Request processed in 468us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403439.122625:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789403439.122663:0:17968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1441dbb80 x1876325050807296/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403455 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403439.122678:0:17968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17968:1876325050807296:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789403439.122689:0:17968:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789403439.122727:0:17968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17968:1876325050807424:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789403439.122763:0:17968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1789403439.122783:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1789403439.122785:0:17968:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5000 going to sleep for 11 seconds 00010000:00010000:3.0:1789403439.122794:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122805:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.122815:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.122820:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122831:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122839:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122847:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122862:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.122872:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.122876:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122883:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.122887:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122909:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122922:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122939:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc32c499/0x5fb08b1e5b76201e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.122954:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.122956:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.122957:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403439.122972:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807424 00000100:00100000:1.0:1789403439.122979:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807424 00000100:00100000:1.0:1789403439.123011:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00002000:00080000:2.0:1789403439.123186:0:19833:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789403439.123192:0:19833:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789403439.123197:0:19833:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:1.0:1789403439.123467:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17968:x1876325050807424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789403439.123701:0:18731:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1789403439.123714:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.123721:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123732:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.123736:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.123742:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123752:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123760:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123768:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123785:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.123795:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.123809:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123818:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.123823:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123833:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123845:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123852:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebeefd75/0x5fb08b1e5b762025 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.123865:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.123867:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.123868:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.125536:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.125547:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.125559:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.125564:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.125569:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.125592:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.125602:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.125697:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.125716:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.126083:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.126089:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.126098:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.126103:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.126113:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.126128:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.126136:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f308ff9/0x5fb08b1e5b76202c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.126160:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.126162:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.126164:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.127496:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.127506:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.127524:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.127529:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.127534:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.127546:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.127556:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.127563:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.127583:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789403439.128016:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.128022:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128042:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.128046:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.128050:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128059:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128068:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128076:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128092:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789403439.128101:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403439.128105:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128113:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.128118:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128127:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128153:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128161:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008785d9e/0x5fb08b1e5b762033 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128180:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.128183:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128190:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.128193:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128201:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128211:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128218:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085d126f2/0x5fb08b1e5b76203a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.128231:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.128232:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.128239:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.129312:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.130458:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.130469:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.130484:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.130488:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.130494:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.130507:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.130516:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.130523:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.130544:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403439.130865:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403439.130872:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.130890:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403439.130971:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.130983:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.131002:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.131010:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fe3d2dd/0x5fb08b1e5b762041 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.131029:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.131031:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.131033:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.131582:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.131589:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.131600:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.131659:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.131665:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.131680:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.131690:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.131697:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.131709:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.131872:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.131878:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.131886:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.131890:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.132229:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.132245:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.132252:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006456346f/0x5fb08b1e5b762048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.132269:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.132270:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.132272:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.132526:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.132533:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132551:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.132554:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.132559:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132569:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132576:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132583:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132599:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.132614:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.132619:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132626:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.132630:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132638:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132659:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132667:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000712a9b89/0x5fb08b1e5b76204f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.132679:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.132681:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.132682:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.133015:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.133021:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133029:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.133032:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.133036:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133045:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133053:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133060:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133086:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.133094:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.133098:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133105:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.133108:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133115:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133126:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133132:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b31ba87/0x5fb08b1e5b762056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133143:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.133145:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.133146:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.133454:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.133461:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133469:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.133472:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.133476:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133486:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133494:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133507:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133518:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.133525:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.133529:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133536:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.133539:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133547:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133569:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133577:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76205d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.133591:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.133592:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.133594:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.133737:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.133744:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133752:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.133761:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.133765:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133774:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133783:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133789:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.133807:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.134009:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.134019:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134027:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.134030:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134038:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134067:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134075:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c72a0718/0x5fb08b1e5b762064 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134089:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.134091:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.134093:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.134165:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.134171:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134178:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.134181:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.134185:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134206:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134213:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134219:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134233:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.134241:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.134244:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134252:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.134255:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134262:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134273:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134280:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b76206b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.134301:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.134302:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.134304:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.138215:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.138227:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138243:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.138248:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.138255:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138271:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138281:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138287:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138304:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.138315:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.138321:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138340:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.138345:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138353:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138370:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138377:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf35c85e/0x5fb08b1e5b762072 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.138411:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.138413:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.138414:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.138957:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.138964:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.138974:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.138977:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.138982:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.138994:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.139001:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.139016:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.139031:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.139183:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.139189:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.139197:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.139201:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.139210:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.139229:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.139237:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b762079 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.139252:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.139254:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.139255:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.140626:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.140634:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140646:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.140650:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.140655:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140666:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140675:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140693:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140714:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403439.140743:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403439.140749:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.140756:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403439.140760:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.140768:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.140788:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.140796:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b762080 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.140810:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.140812:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.140814:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.140876:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.140882:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140956:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.140959:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.140963:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140972:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140979:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.140986:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.141007:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403439.141047:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403439.141055:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.141207:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403439.141212:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.141282:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.141299:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.141305:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762087 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.141326:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403439.141328:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403439.141330:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.142735:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1789403439.142739:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.142745:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142745:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.142758:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.142758:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.142763:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.142763:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.142770:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142770:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.142782:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142782:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.142792:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.142801:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142803:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142811:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.142824:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789403439.142908:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789403439.142919:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403439.142925:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142933:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.142937:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142946:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142961:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142969:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083320e49/0x5fb08b1e5b762095 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.142984:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.142994:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.142996:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.143001:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.143004:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143011:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143021:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143028:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f682715b/0x5fb08b1e5b76208e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143040:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.143042:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.143043:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.143355:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.143361:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143369:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.143371:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.143375:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143383:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143413:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143420:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143436:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.143661:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.143666:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143675:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.143678:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143703:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143715:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143722:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef76ce4/0x5fb08b1e5b76209c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.143799:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.143801:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.143803:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.143909:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.143915:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143924:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.143933:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.143937:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143947:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143955:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143963:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143976:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.143984:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.143989:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.143996:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.143999:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.144007:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.144019:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.144037:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b7620a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.144052:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.144054:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.144056:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.144310:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.144316:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144324:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.144328:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.144336:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144345:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144353:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144366:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144381:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403439.144523:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403439.144529:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144536:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403439.144540:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144548:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144560:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144567:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b7620aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144592:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.144594:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.144596:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.144695:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.144700:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144709:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.144712:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.144716:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144726:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144734:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144741:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403439.144771:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403439.144777:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144784:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=485s v=(0 0) 00010000:00010000:1.0:1789403439.144788:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403439.144792:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144801:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144809:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.144816:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.144863:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789403439.144943:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789403439.145057:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403439.145063:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145070:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.145074:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145081:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145093:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145111:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b7620b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403439.145115:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.145120:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145124:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.145128:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145133:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.145137:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.145139:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.145141:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145142:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145150:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145151:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145159:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145161:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145167:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145169:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000441099e9/0x5fb08b1e5b7620b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145180:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.145183:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145189:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.145196:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145204:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145214:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145220:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789403439.145227:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b7620bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.145240:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.145242:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.145513:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.145518:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145525:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.145528:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.145532:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145541:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145558:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.145564:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145630:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403439.145636:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145653:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403439.145656:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145663:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145675:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145684:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.145686:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.145687:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403439.145722:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403439.145728:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145735:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=485s v=(0 0) 00010000:00010000:1.0:1789403439.145738:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403439.145741:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145749:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145757:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145769:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145782:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403439.145790:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403439.145793:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145801:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403439.145804:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145812:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145822:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145829:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015e5ea85/0x5fb08b1e5b7620cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.145842:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.145844:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.145846:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403439.146147:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403439.146160:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146168:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=485s v=(0 0) 00010000:00010000:1.0:1789403439.146171:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403439.146175:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146185:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146193:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146200:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146213:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403439.146220:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403439.146223:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146230:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403439.146233:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146241:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146258:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146266:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb2676cd/0x5fb08b1e5b7620d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403439.146280:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.146282:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403439.146283:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.146352:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.146360:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.148431:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789403439.148444:0:19833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.148796:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.153499:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.153512:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.153530:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.153534:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.153540:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403439.153549:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.153557:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.153560:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.153579:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.153580:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1789403439.153589:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403439.153596:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.153619:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.153648:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.153652:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.153662:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403439.153663:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153670:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.153677:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153686:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.153694:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153703:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.153705:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.153724:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153733:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f682715b/0x5fb08b1e5b7620db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153748:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.153752:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153766:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.153769:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153776:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153788:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153794:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7620e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.153806:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.153808:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.153810:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.153816:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.154484:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.154491:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.154502:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.154506:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.154510:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.154520:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.154528:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.154535:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.154559:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403439.154752:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403439.154758:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.154767:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403439.154771:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.154779:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.154794:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.154801:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7620e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.154823:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403439.154825:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403439.154827:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.156014:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.156023:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156042:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.156046:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.156052:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156064:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156076:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156085:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156100:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789403439.156242:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.156248:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156256:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.156259:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.156263:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156271:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156290:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156297:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.156310:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789403439.157641:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.157650:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.157663:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.157667:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.157672:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.157682:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.157691:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.157698:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.157737:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789403439.158010:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.158016:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158024:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.158027:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.158030:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158038:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158045:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158051:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158058:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789403439.158350:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.158356:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158364:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.158373:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.158377:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158403:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158412:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158418:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158426:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1789403439.158522:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403439.158528:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158537:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1789403439.158540:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403439.158544:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158554:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158562:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158570:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158579:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1789403439.158846:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.158853:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158863:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.158867:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.158872:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158883:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158892:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.158918:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158923:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789403439.158929:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1789403439.158931:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158953:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403439.158959:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158967:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.158985:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159081:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789403439.159088:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159095:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.159098:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159116:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159127:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159133:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b7620f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159150:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789403439.159153:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159159:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.159162:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159170:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159180:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159182:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b7620f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159188:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076bdfda/0x5fb08b1e5b7620fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159196:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789403439.159200:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159206:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.159210:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789403439.159210:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159213:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159218:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159220:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.159223:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159228:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159231:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159240:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762105 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159241:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159248:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76210c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159252:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403439.159255:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159257:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.159260:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159261:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403439.159264:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159267:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.159270:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159272:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159281:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159287:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159288:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000345f6ab1/0x5fb08b1e5b762113 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.159296:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159299:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403439.159301:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.159302:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb82c623/0x5fb08b1e5b76211a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403439.159303:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.159312:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.159314:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.159315:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.159322:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789403439.160629:0:19545:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789403439.160654:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789403439.160658:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789403439.161242:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17968:x1876325050807424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 38217us (38472us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789403439.161255:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:2.0:1789403439.161355:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.161362:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161376:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.161381:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.161408:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161421:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161430:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161437:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161463:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.161473:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.161478:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161485:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.161489:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161498:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161514:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161522:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762121 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.161538:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.161540:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.161541:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.162356:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.162364:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162375:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.162385:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.162411:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162424:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162433:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162440:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162456:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789403439.162608:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.162614:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162622:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.162625:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.162628:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162638:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162646:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162660:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.162673:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1789403439.162884:0:17968:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789403439.162902:0:17968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17968:1876325050807424:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789403439.162918:0:17968:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789403439.162965:0:17968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17968:1876325050807552:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789403439.163011:0:17968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.163036:0:17968:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789403439.163051:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403439.163056:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163074:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.163079:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163088:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163101:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163109:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762128 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163124:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.163128:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163134:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.163138:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163145:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163155:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163169:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76212f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163182:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.163184:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.163186:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.163191:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403439.163303:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807552 00000100:00100000:2.0:1789403439.163310:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807552 00000100:00100000:2.0:1789403439.163350:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403439.163360:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17968:x1876325050807552:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789403439.163434:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17968:x1876325050807552:12345-0@lo:900:osp-pre-1-1.0 Request processed in 75us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403439.163441:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1789403439.163496:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.163502:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163511:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.163516:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.163525:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163535:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163543:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163561:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163575:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.163677:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.163683:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163691:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.163694:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163702:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163713:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163720:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039338fde/0x5fb08b1e5b762136 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.163734:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.163736:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.163737:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1789403439.163818:0:17968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a250e29180 x1876325050807552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403455 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403439.163830:0:17968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17968:1876325050807552:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789403439.163953:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.163959:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163968:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.163971:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.163975:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163985:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.163993:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.164012:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403439.164085:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.164097:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164105:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.164108:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.164112:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164120:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164128:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164135:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164150:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.164239:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.164245:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164252:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.164255:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164262:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164280:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164288:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df713c85/0x5fb08b1e5b762144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164302:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.164304:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.164306:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.164340:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.164530:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.164537:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164545:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.164549:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164557:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164570:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164577:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ea9186/0x5fb08b1e5b76213d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.164606:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.164608:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.164610:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.165054:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.165062:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165070:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.165074:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.165078:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165089:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165095:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165101:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165113:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.165162:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.165167:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165174:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.165177:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165185:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165196:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165202:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf35c85e/0x5fb08b1e5b76214b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165216:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.165218:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.165219:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.165257:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.165262:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165281:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.165283:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.165287:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165295:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165303:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165310:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165322:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.165329:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.165332:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165338:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.165341:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165348:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165367:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165373:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.165385:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.165405:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.165407:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.165798:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.165804:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165825:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.165828:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.165901:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165912:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165920:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165929:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.165943:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403439.166055:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403439.166061:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166068:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403439.166071:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166078:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166089:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166097:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008652f954/0x5fb08b1e5b762159 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166124:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.166126:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403439.166128:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.166165:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.166170:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166178:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.166181:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.166186:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166455:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166466:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.166473:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.167092:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789403439.167873:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.167881:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.167913:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.167916:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.167922:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.167933:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.167942:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.167950:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168443:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403439.168452:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168460:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.168464:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168472:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168497:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168504:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762160 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168522:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.168525:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168531:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.168534:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168540:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168549:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168555:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.168556:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.168558:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403439.168776:0:18732:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403439.168782:0:18732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168796:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=485s v=(0 0) 00010000:00010000:3.0:1789403439.168800:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403439.168805:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168816:0:18732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168823:0:18732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.168829:0:18732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169003:0:18732:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789403439.169069:0:18732:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1789403439.169154:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17249:x1876325050806656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67815us (68731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403439.169162:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789403439.169192:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.169197:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169205:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.169208:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169226:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169238:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169247:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007406050/0x5fb08b1e5b76216e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169263:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.169264:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.169266:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403439.169302:0:17249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17249:1876325050806656:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789403439.169317:0:17249:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789403439.169363:0:17249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17249:1876325050807680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789403439.169420:0:17249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403439.169445:0:17249:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403439.169461:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807680 00000100:00100000:3.0:1789403439.169466:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807680 00000100:00100000:3.0:1789403439.169506:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789403439.169515:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17249:x1876325050807680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789403439.169546:0:18733:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1789403439.169731:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789403439.169737:0:19833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b762167 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.169984:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.171356:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.171366:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.171380:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.171384:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.171419:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.171444:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.171454:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.171462:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.171479:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.171628:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.171640:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.171648:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.171652:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.171661:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.171674:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.171681:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b939c62/0x5fb08b1e5b762175 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.171697:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.171699:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.171701:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.172139:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.172145:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172154:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.172157:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.172161:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172170:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172177:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172194:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172211:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.172423:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.172429:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.172438:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.172442:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.172462:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.172474:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.172482:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df713c85/0x5fb08b1e5b76217c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.172496:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.172497:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.172499:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.172744:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.172750:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172759:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.172762:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.172766:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172776:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172784:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172792:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.172808:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403439.173576:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.173584:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.173594:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.173599:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.173669:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.173686:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.173707:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039338fde/0x5fb08b1e5b762183 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.173723:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.173725:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.173727:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403439.174769:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.174778:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.174796:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.174801:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.174808:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175144:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175153:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175161:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175179:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789403439.175738:0:19833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403439.175745:0:19833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175753:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1789403439.175756:0:19833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403439.175761:0:19833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175770:0:19833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175788:0:19833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175795:0:19833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403439.175809:0:19833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789403439.176038:0:19833:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1789403439.176127:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17251:x1876325050807168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 56133us (74581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403439.176137:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403439.176467:0:17251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17251:1876325050807168:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789403439.176485:0:17251:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789403439.176530:0:17251:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17251:1876325050807808:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789403439.176567:0:17251:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403439.176962:0:17251:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1431dbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403439.176985:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807808 00000100:00100000:2.0:1789403439.176992:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807808 00000100:00100000:2.0:1789403439.177030:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403439.177038:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17251:x1876325050807808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789403439.177071:0:18731:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1789403439.178542:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403439.178552:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178565:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.178571:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178582:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178602:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178628:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f2eb36/0x5fb08b1e5b76218a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178649:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403439.178653:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178666:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403439.178669:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178677:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178688:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178696:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762191 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403439.178710:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.178712:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.178714:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403439.178721:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789403439.181049:0:18727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789403439.181090:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789403439.181857:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17249:x1876325050807680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12338us (12432us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789403439.181886:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789403439.181945:0:17249:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789403439.181952:0:17249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17249:1876325050807680:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789403439.181967:0:17249:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1789403439.185234:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17251:x1876325050807808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8190us (8662us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789403439.185259:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403439.185333:0:17251:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17251:1876325050807808:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789403439.185349:0:17251:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789403439.354587:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789403440.248348:0:19902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789403440.373576:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403441.060933:0:19954:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403441.061177:0:19954:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403441.394023:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403441.918795:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403441.918818:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050807936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403441.918897:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403441.918942:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050807936 00000100:00100000:0.0:1789403441.918950:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050807936 00000100:00080000:1.0:1789403441.918982:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403441.919007:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403441.919016:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050807936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403441.919045:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789403441.919095:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050807936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403441.919102:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403441.919210:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050807936:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1789403442.022258:0:20004:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403442.022524:0:20004:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789403442.379013:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.379107:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148224 00000100:00100000:2.0:1789403442.379118:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148224 00000100:00100000:2.0:1789403442.379167:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:2.0:1789403442.379174:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2386:x1876325038148224:12345-192.168.203.43@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789403442.379201:0:17218:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 70eabb3e-21f5-4353-a0a0-bbe22517a3d6@192.168.203.43@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1789403442.379226:0:17218:0:(genops.c:1384:class_connect()) connect: client 70eabb3e-21f5-4353-a0a0-bbe22517a3d6, cookie 0x5fb08b1e5b762198 00000100:00080000:2.0:1789403442.379361:0:17218:0:(import.c:65:import_set_state_nolock()) ffff90a14455c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403442.379460:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+5:2386:x1876325038148224:12345-192.168.203.43@tcp:250:mount.lustre.0 Request processed in 284us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.379467:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:0.0:1789403442.387007:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.387157:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148352 00000100:00100000:1.0:1789403442.387167:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148352 00000100:00100000:1.0:1789403442.387225:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:1.0:1789403442.387235:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+5:14884:x1876325038148352:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789403442.387251:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403442.387268:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b76219f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128aef expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.387295:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b76219f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aef expref: 6 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.387306:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b76219f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aef expref: 6 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.387328:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04a00, rc 0) 00000100:00100000:1.0:1789403442.387385:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+6:14884:x1876325038148352:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 151us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.387424:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 113 00000100:00100000:0.0:1789403442.390522:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.390729:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148480 00000100:00100000:1.0:1789403442.390739:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148480 00000100:00100000:1.0:1789403442.390791:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:1.0:1789403442.390800:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+6:14884:x1876325038148480:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789403442.391076:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+6:14884:x1876325038148480:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 275us (560us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403442.391085:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 114 00000100:00100000:0.0:1789403442.398646:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.399256:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148608 00000100:00100000:2.0:1789403442.399268:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148608 00000100:00100000:2.0:1789403442.399319:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:2.0:1789403442.399329:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+6:14884:x1876325038148608:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403442.399346:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403442.399364:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184200/0x5fb08b1e5b7621a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128af6 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403442.399429:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184200/0x5fb08b1e5b7621a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128af6 expref: 7 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403442.399440:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184200/0x5fb08b1e5b7621a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128af6 expref: 7 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403442.399448:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184200, rc 0) 00000100:00100000:2.0:1789403442.399525:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+7:14884:x1876325038148608:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 197us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.399547:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1789403442.411455:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.412460:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148736 00000100:00100000:1.0:1789403442.412473:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148736 00000100:00100000:1.0:1789403442.412615:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:1.0:1789403442.412624:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+7:14884:x1876325038148736:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789403442.412849:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14884:x1876325038148736:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 224us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.412857:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:1.0:1789403442.417867:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050808064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403442.417951:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403442.418000:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808064 00000100:00100000:1.0:1789403442.418008:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808064 00000100:00100000:1.0:1789403442.418317:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789403442.418326:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050808064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403442.418369:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789403442.418438:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050808064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.418445:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789403442.418488:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050808064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403442.420283:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050808192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403442.420342:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403442.420469:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808192 00000100:00100000:3.0:1789403442.420478:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808192 00000100:00100000:3.0:1789403442.420526:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403442.420535:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050808192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403442.420565:0:19382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403442.420622:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050808192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403442.420628:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789403442.420779:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050808192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789403442.421721:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403442.424051:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.424268:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148864 00000100:00100000:0.0:1789403442.424278:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148864 00000100:00100000:0.0:1789403442.424338:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:0.0:1789403442.424348:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14884:x1876325038148864:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789403442.424533:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14884:x1876325038148864:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 186us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.424541:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:0.0:1789403442.444142:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.452185:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038148992 00000100:00100000:1.0:1789403442.452201:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038148992 00000100:00100000:1.0:1789403442.452334:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:1.0:1789403442.452346:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14902:x1876325038148992:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403442.452533:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14902:x1876325038148992:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 188us (8399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.452541:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:1.0:1789403442.485162:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.485428:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149120 00000100:00100000:2.0:1789403442.485447:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149120 00000100:00100000:2.0:1789403442.485520:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:2.0:1789403442.485533:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14902:x1876325038149120:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789403442.485703:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14902:x1876325038149120:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 173us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.485712:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1789403442.492213:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.492593:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149248 00000100:00100000:1.0:1789403442.492604:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149248 00000100:00100000:1.0:1789403442.492668:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:1.0:1789403442.492679:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14902:x1876325038149248:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403442.492992:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14902:x1876325038149248:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 314us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.493000:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:0.0:1789403442.500763:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.500956:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149376 00000100:00100000:2.0:1789403442.500967:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149376 00000100:00100000:2.0:1789403442.501024:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:2.0:1789403442.501034:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+8:14884:x1876325038149376:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403442.501050:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403442.501075:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185600/0x5fb08b1e5b7621ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128b27 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403442.501103:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185600/0x5fb08b1e5b7621ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b27 expref: 9 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403442.501114:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185600/0x5fb08b1e5b7621ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b27 expref: 9 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403442.501123:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185600, rc 0) 00000100:00100000:2.0:1789403442.501180:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+9:14884:x1876325038149376:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 148us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.501201:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:2.0:1789403442.507837:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.508054:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149504 00000100:00100000:0.0:1789403442.508135:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149504 00000100:00100000:0.0:1789403442.508225:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:0.0:1789403442.508236:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+9:14884:x1876325038149504:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789403442.508262:0:17219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789403442.508280:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789403442.508284:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789403442.508287:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789403442.508290:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789403442.508293:0:17219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789403442.511837:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+9:14884:x1876325038149504:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 3593us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.511853:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:1.0:1789403442.516145:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.516602:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149632 00000100:00100000:0.0:1789403442.516613:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149632 00000100:00100000:0.0:1789403442.516737:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:0.0:1789403442.516748:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+9:14884:x1876325038149632:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789403442.516764:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403442.516796:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128b2e expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403442.516825:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 10 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403442.516837:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 10 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403442.516846:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9600, rc 0) 00000100:00100000:0.0:1789403442.516923:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14884:x1876325038149632:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 178us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.516938:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:2.0:1789403442.521141:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.521228:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149760 00000100:00100000:0.0:1789403442.521237:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149760 00000100:00100000:0.0:1789403442.521338:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:0.0:1789403442.521349:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14884:x1876325038149760:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403442.521748:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14884:x1876325038149760:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 399us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.521755:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:3.0:1789403442.525971:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.526363:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038149888 00000100:00100000:0.0:1789403442.526373:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038149888 00000100:00100000:0.0:1789403442.526465:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:0.0:1789403442.526487:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14884:x1876325038149888:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789403442.526640:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14884:x1876325038149888:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 158us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.526648:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:1.0:1789403442.531047:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.531369:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150016 00000100:00100000:0.0:1789403442.531380:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150016 00000100:00100000:0.0:1789403442.531460:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:0.0:1789403442.531482:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14907:x1876325038150016:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403442.531638:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14907:x1876325038150016:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 169us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.531646:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:1.0:1789403442.537300:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.538766:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150144 00000100:00100000:2.0:1789403442.538779:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150144 00000100:00100000:2.0:1789403442.538880:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:2.0:1789403442.538891:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14907:x1876325038150144:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789403442.539074:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:14907:x1876325038150144:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 184us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.539083:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:3.0:1789403442.545595:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403442.545675:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.545995:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150272 00000100:00100000:1.0:1789403442.546005:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150272 00000100:00100000:1.0:1789403442.546061:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150528 00000100:00100000:1.0:1789403442.546064:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150528 00000100:00100000:1.0:1789403442.546084:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1789403442.546092:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1876325038150272:12345-192.168.203.43@tcp:38:mount.lustre.0 00000100:00100000:3.0:1789403442.546356:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:3.0:1789403442.546363:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1876325038150528:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789403442.546383:0:17225:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 6e04e948-ba92-4319-8cea-8a865bfd1e14@192.168.203.43@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:3.0:1789403442.546456:0:17225:0:(genops.c:1384:class_connect()) connect: client 6e04e948-ba92-4319-8cea-8a865bfd1e14, cookie 0x5fb08b1e5b7621bb 00000004:00100000:3.0:1789403442.546481:0:17225:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789403442.546694:0:17225:0:(import.c:65:import_set_state_nolock()) ffff90a143335000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403442.546765:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2386:x1876325038150528:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 400us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403442.546773:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00010000:00080000:1.0:1789403442.547424:0:19353:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6e04e948-ba92-4319-8cea-8a865bfd1e14@192.168.203.43@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:1.0:1789403442.547463:0:19353:0:(genops.c:1384:class_connect()) connect: client 6e04e948-ba92-4319-8cea-8a865bfd1e14, cookie 0x5fb08b1e5b7621c2 00000004:00100000:1.0:1789403442.547479:0:19353:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789403442.547645:0:19353:0:(import.c:65:import_set_state_nolock()) ffff90a1434d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403442.547690:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2386:x1876325038150272:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 1597us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.547697:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403442.551667:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403442.551707:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403442.551738:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.554237:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150656 00000100:00100000:0.0:1789403442.554251:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150656 00000100:00100000:0.0:1789403442.554352:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150784 00000100:00100000:0.0:1789403442.554355:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150784 00000100:00100000:0.0:1789403442.554372:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150400 00000100:00100000:0.0:1789403442.554375:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150400 00000100:00100000:0.0:1789403442.554421:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1789403442.554434:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:0:x1876325038150656:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789403442.554464:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789403442.554558:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:0:x1876325038150656:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 127us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.554565:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1789403442.554583:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1789403442.554590:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:14884:x1876325038150784:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789403442.554609:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789403442.554646:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:14884:x1876325038150784:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 57us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.554653:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1789403442.554665:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1789403442.554672:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:0:x1876325038150400:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789403442.554683:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789403442.554705:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:0:x1876325038150400:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 34us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.554711:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00080000:3.0:1789403442.554909:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403442.554914:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403442.559704:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.559968:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038150912 00000100:00100000:0.0:1789403442.559978:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038150912 00000100:00100000:0.0:1789403442.560057:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1789403442.560067:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14884:x1876325038150912:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789403442.560346:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14884:x1876325038150912:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 279us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.560354:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:0.0:1789403442.564964:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403442.565021:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.565235:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151040 00000100:00100000:2.0:1789403442.565246:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151040 00000100:00100000:2.0:1789403442.565290:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151168 00000100:00100000:2.0:1789403442.565293:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151168 00000100:00100000:2.0:1789403442.565322:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1789403442.565329:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1876325038151040:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789403442.565363:0:19833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6e04e948-ba92-4319-8cea-8a865bfd1e14@192.168.203.43@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1789403442.565416:0:19833:0:(genops.c:1384:class_connect()) connect: client 6e04e948-ba92-4319-8cea-8a865bfd1e14, cookie 0x5fb08b1e5b7621c9 00002000:00100000:2.0:1789403442.565427:0:19833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e04e948-ba92-4319-8cea-8a865bfd1e14/ffff90a144558000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789403442.565437:0:19833:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789403442.565615:0:19833:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789403442.565643:0:19833:0:(import.c:65:import_set_state_nolock()) ffff90a144559000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403442.565700:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2386:x1876325038151040:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 370us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.565708:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:2.0:1789403442.565737:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1789403442.565741:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1876325038151168:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789403442.565758:0:19833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6e04e948-ba92-4319-8cea-8a865bfd1e14@192.168.203.43@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1789403442.565772:0:19833:0:(genops.c:1384:class_connect()) connect: client 6e04e948-ba92-4319-8cea-8a865bfd1e14, cookie 0x5fb08b1e5b7621d0 00002000:00100000:2.0:1789403442.565777:0:19833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e04e948-ba92-4319-8cea-8a865bfd1e14/ffff90a144559800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789403442.565788:0:19833:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789403442.565894:0:19833:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789403442.565910:0:19833:0:(import.c:65:import_set_state_nolock()) ffff90a14455a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403442.565935:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2386:x1876325038151168:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 192us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.565942:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1789403442.569059:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.569330:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151296 00000100:00100000:2.0:1789403442.569340:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151296 00000100:00100000:2.0:1789403442.569435:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1789403442.569447:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14884:x1876325038151296:12345-192.168.203.43@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789403442.569557:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14884:x1876325038151296:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 113us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403442.569565:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1789403442.573445:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403442.573854:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151424 00000100:00100000:2.0:1789403442.573864:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151424 00000100:00100000:2.0:1789403442.573964:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1789403442.573976:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14884:x1876325038151424:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789403442.577230:0:17227:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3137us 00000004:00200000:0.0:1789403442.601861:0:17227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789403442.602008:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14884:x1876325038151424:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 28029us (28567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403442.602021:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1789403442.810546:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403442.813752:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151552 00000100:00100000:1.0:1789403442.813780:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151552 00000100:00100000:1.0:1789403442.813962:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1789403442.813976:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14930:x1876325038151552:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:1.0:1789403442.814005:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403442.814163:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7621d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128b5f expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.814254:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b7621de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.814270:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b7621de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.814308:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b7621de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403442.815885:0:19353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403442.815896:0:19353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403442.815969:0:19353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b7621de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.816016:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04e00/0x5fb08b1e5b7621d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b5f expref: 8 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.816044:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b7621de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b5f expref: 7 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403442.816053:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:1.0:1789403442.816057:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403442.816061:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04600, rc 0) 00000100:00100000:1.0:1789403442.816337:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:14930:x1876325038151552:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 2362us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403442.816347:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00010000:00010000:3.0:1789403443.441711:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403444.465756:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403444.465786:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050808320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403444.465895:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403444.465991:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050808448:0@lo:400:kworker.0 00000100:00100000:3.0:1789403444.466041:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403444.466090:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050808960:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.466131:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050808704:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.466207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403444.466215:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403444.466290:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808320 00000100:00100000:2.0:1789403444.466314:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808320 00000100:00100000:2.0:1789403444.466447:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403444.466465:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050808320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403444.466495:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789403444.466553:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050808832:0@lo:400:kworker.0 00000100:00100000:3.0:1789403444.473911:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050809472:0@lo:400:kworker.0 00000100:00100000:3.0:1789403444.474009:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403444.474073:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050809984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403444.474133:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050808320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7668us (8231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403444.474148:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403444.474339:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403444.474425:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050808320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403444.474490:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808704 00000100:00100000:3.0:1789403444.474499:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808704 00000100:00100000:3.0:1789403444.474573:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403444.474583:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050808704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403444.474803:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050808704:12345-0@lo:400:kworker.0 Request processed in 221us (8596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403444.474831:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789403444.474909:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403444.474913:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403444.474958:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809984 00000100:00100000:3.0:1789403444.474963:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809984 00000100:00100000:1.0:1789403444.475192:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050808704:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.475207:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050809216:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.475257:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403444.475291:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050809728:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.475337:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403444.475377:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789403444.475385:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050808576:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.475429:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403444.475450:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050809088:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.475471:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403444.475489:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050809600:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.476127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403444.476156:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050810112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403444.476186:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403444.476224:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808448 00000100:00100000:1.0:1789403444.476232:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808448 00000100:00100000:1.0:1789403444.476282:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789403444.476291:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3627:x1876325050808448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.476344:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3627:x1876325050808448:12345-0@lo:400:kworker.0 Request processed in 54us (10306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.476351:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789403444.476386:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809216 00000100:00100000:1.0:1789403444.476413:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809216 00000100:00100000:1.0:1789403444.476450:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403444.476457:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050809216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.477131:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050809216:12345-0@lo:400:kworker.0 Request processed in 671us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.477142:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403444.477170:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808576 00000100:00100000:1.0:1789403444.477174:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808576 00000100:00100000:1.0:1789403444.477212:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809088 00000100:00100000:1.0:1789403444.477216:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809088 00000100:00100000:1.0:1789403444.477230:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403444.477236:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050808576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.477277:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050808576:12345-0@lo:400:kworker.0 Request processed in 41us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.477283:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403444.477293:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403444.477299:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050809088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.477324:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050809088:12345-0@lo:400:kworker.0 Request processed in 26us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.477330:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789403444.477355:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403444.477368:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808960 00000100:00100000:1.0:1789403444.477371:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808960 00000100:00100000:2.0:1789403444.477410:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810112 00000100:00100000:1.0:1789403444.477414:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809472 00000100:00100000:2.0:1789403444.477417:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810112 00000100:00100000:1.0:1789403444.477420:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809472 00000100:00100000:3.0:1789403444.477816:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403444.477840:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050809984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403444.477894:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789403444.477972:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050809984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403444.477980:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403444.478018:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809728 00000100:00100000:3.0:1789403444.478025:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809728 00000100:00100000:3.0:1789403444.478077:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809600 00000100:00100000:3.0:1789403444.478082:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809600 00000100:00100000:1.0:1789403444.478092:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403444.478105:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050808960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478159:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050808960:12345-0@lo:400:kworker.0 Request processed in 58us (11949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.478166:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789403444.478182:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403444.478189:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050809728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478219:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050809728:12345-0@lo:400:kworker.0 Request processed in 30us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.478225:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403444.478257:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403444.478267:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403444.478270:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050810112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403444.478281:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050809472:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789403444.478290:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789403444.478312:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789403444.478329:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050809600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478341:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050809472:12345-0@lo:400:kworker.0 Request processed in 57us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.478353:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789403444.478416:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050809600:12345-0@lo:400:kworker.0 Request processed in 92us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403444.478426:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789403444.478444:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050808576:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478462:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050809088:0@lo:400:kworker.0 00010000:00080000:1.0:1789403444.478481:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b5c00 x1876325050809600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403444.478486:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050810112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.478497:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050809600:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478536:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050810112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403444.478549:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050809216:0@lo:400:kworker.0 00000100:00100000:2.0:1789403444.478550:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403444.478571:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050809728:0@lo:400:kworker.0 00010000:00010000:2.0:1789403444.478584:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789403444.478595:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403444.478600:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403444.478603:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403444.478888:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050809984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403444.478904:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050808960:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478922:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050809472:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.478933:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050808448:0@lo:400:kworker.0 00000100:00100000:0.0:1789403444.479476:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403444.479543:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050809344:0@lo:400:kworker.0 00000100:00100000:0.0:1789403444.479592:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403444.479642:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050809856:0@lo:400:kworker.0 00000100:00100000:0.0:1789403444.479665:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403444.479803:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809344 00000100:00100000:3.0:1789403444.479814:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809344 00000100:00100000:1.0:1789403444.479831:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050808832 00000100:00100000:1.0:1789403444.479842:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050808832 00000100:00100000:3.0:1789403444.479890:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050809856 00000100:00100000:3.0:1789403444.479896:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050809856 00000100:00100000:1.0:1789403444.479911:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789403444.479924:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050808832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403444.479946:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403444.479958:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050809344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403444.480082:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403444.480096:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050809856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403444.480212:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050808832:0@lo:400:kworker.0 00000100:00100000:3.0:1789403444.481006:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050809344:12345-0@lo:400:kworker.0 Request processed in 1044us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403444.481019:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789403444.481066:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403444.481296:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050809344:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.483513:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050808832:12345-0@lo:400:kworker.0 Request processed in 3580us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403444.483750:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403444.487515:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050809856:12345-0@lo:400:kworker.0 Request processed in 7410us (7835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403444.487535:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789403444.487728:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a143513800 x1876325050809856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403444.487747:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050809856:0@lo:400:kworker.0 00000100:00100000:1.0:1789403444.721260:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403444.721531:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151680 00000100:00100000:0.0:1789403444.721545:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151680 00000100:00100000:0.0:1789403444.721984:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1789403444.721998:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:14982:x1876325038151680:12345-192.168.203.43@tcp:41:lfs.0 00000100:00080000:2.0:1789403444.722118:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789403444.722162:0:19353:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789403444.722421:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:14982:x1876325038151680:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 395us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403444.722430:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:0.0:1789403444.727657:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403444.727755:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151808 00000100:00100000:3.0:1789403444.727769:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151808 00000100:00100000:3.0:1789403444.727870:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1789403444.727881:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14982:x1876325038151808:12345-192.168.203.43@tcp:41:lfs.0 00000004:00000024:3.0:1789403444.727947:0:17224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:2.0:1789403444.728194:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403444.728242:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14982:x1876325038151808:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 361us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403444.728251:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1789403444.732226:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403444.733181:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038151936 00000100:00100000:0.0:1789403444.733197:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038151936 00000100:00100000:0.0:1789403444.733307:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1789403444.733321:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14982:x1876325038151936:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:0.0:1789403444.733358:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789403444.733546:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14982:x1876325038151936:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 227us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403444.733555:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00080000:2.0:1789403444.734165:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403444.742141:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403444.742306:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152064 00000100:00100000:0.0:1789403444.742319:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152064 00000100:00100000:0.0:1789403444.742432:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1789403444.742445:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14982:x1876325038152064:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:0.0:1789403444.742479:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1789403444.742662:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403444.742729:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:14982:x1876325038152064:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 286us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403444.742738:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1789403444.949077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403444.949279:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152192 00000100:00100000:2.0:1789403444.949297:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152192 00000100:00100000:2.0:1789403444.949445:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:2.0:1789403444.949458:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:15016:x1876325038152192:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403444.949486:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403444.949513:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184800/0x5fb08b1e5b7621e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128b66 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403444.949559:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184800/0x5fb08b1e5b7621e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b66 expref: 11 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403444.949572:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184800/0x5fb08b1e5b7621e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b66 expref: 11 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403444.949582:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184800, rc 0) 00000100:00100000:2.0:1789403444.949965:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15016:x1876325038152192:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 508us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403444.949973:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:2.0:1789403444.964360:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403444.964583:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152320 00000100:00100000:0.0:1789403444.964597:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152320 00000100:00100000:0.0:1789403444.964666:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:0.0:1789403444.964680:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15016:x1876325038152320:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403444.964912:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15016:x1876325038152320:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 235us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403444.964921:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:1.0:1789403444.972262:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403444.973058:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152448 00000100:00100000:2.0:1789403444.973075:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152448 00000100:00100000:2.0:1789403444.973172:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:2.0:1789403444.973184:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15016:x1876325038152448:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789403444.973662:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15016:x1876325038152448:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 479us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403444.973673:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000001:00100000:2.0:1789403444.990143:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000001:00100000:0.0:1789403444.991364:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000001:00080000:0.0:1789403444.991381:0:19545:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1789403444.996766:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403444.997178:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152576 00000100:00100000:3.0:1789403444.997192:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152576 00000100:00100000:3.0:1789403444.997266:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:3.0:1789403444.997278:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15022:x1876325038152576:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789403444.997517:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15022:x1876325038152576:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 241us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403444.997526:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:3.0:1789403445.044884:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403445.049302:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152704 00000100:00100000:0.0:1789403445.049333:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152704 00000100:00100000:0.0:1789403445.049442:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:0.0:1789403445.049455:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15022:x1876325038152704:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403445.049688:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15022:x1876325038152704:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 235us (4818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.049698:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:1.0:1789403445.055760:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403445.056093:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152832 00000100:00100000:2.0:1789403445.056117:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152832 00000100:00100000:2.0:1789403445.056183:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:2.0:1789403445.056195:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15022:x1876325038152832:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789403445.056446:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15022:x1876325038152832:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 252us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403445.056456:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:1.0:1789403445.062668:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403445.062773:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038152960 00000100:00100000:3.0:1789403445.062787:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038152960 00000100:00100000:3.0:1789403445.062873:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:3.0:1789403445.062885:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:15016:x1876325038152960:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789403445.062907:0:17217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403445.062929:0:17217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b7621ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128b97 expref: -99 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403445.062964:0:17217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b7621ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b97 expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403445.062976:0:17217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b7621ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b97 expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403445.062985:0:17217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241515e00, rc 0) 00000100:00100000:3.0:1789403445.063075:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:15016:x1876325038152960:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 193us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403445.063083:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:3.0:1789403445.069011:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403445.069219:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153088 00000100:00100000:0.0:1789403445.069233:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153088 00000100:00100000:0.0:1789403445.069356:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:0.0:1789403445.069379:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:15016:x1876325038153088:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789403445.069460:0:17219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789403445.069490:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789403445.069495:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789403445.069504:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789403445.069508:0:17219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789403445.069510:0:17219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789403445.080984:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:15016:x1876325038153088:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 11599us (11969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.081003:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:1.0:1789403445.090652:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403445.090768:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153216 00000100:00100000:2.0:1789403445.090780:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153216 00000100:00100000:2.0:1789403445.090847:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:2.0:1789403445.090926:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:15016:x1876325038153216:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403445.090952:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403445.090976:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128b9e expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403445.091015:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 13 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403445.091028:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 13 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403445.091037:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184e00, rc 0) 00000100:00100000:2.0:1789403445.091524:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15016:x1876325038153216:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 600us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403445.091533:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:2.0:1789403445.097206:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403445.097429:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153344 00000100:00100000:0.0:1789403445.097443:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153344 00000100:00100000:0.0:1789403445.097516:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1789403445.097528:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24845cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15016:x1876325038153344:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403445.097727:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24845cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15016:x1876325038153344:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 200us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.097735:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:1.0:1789403445.101638:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403445.101754:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153472 00000100:00100000:2.0:1789403445.101786:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153472 00000100:00100000:2.0:1789403445.101914:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:2.0:1789403445.101926:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15016:x1876325038153472:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789403445.102123:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15016:x1876325038153472:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 198us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403445.102133:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:1.0:1789403445.106766:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403445.107023:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153600 00000100:00100000:3.0:1789403445.107037:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153600 00000100:00100000:3.0:1789403445.107119:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:3.0:1789403445.107132:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15028:x1876325038153600:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789403445.108346:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15028:x1876325038153600:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 1206us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403445.108361:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:3.0:1789403445.119739:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403445.126364:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153728 00000100:00100000:0.0:1789403445.126401:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153728 00000100:00100000:0.0:1789403445.126571:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:0.0:1789403445.126584:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15028:x1876325038153728:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403445.126812:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:15028:x1876325038153728:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 230us (7087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.126820:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:1.0:1789403445.142530:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403445.142654:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403445.142762:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153856 00000100:00100000:0.0:1789403445.142776:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153856 00000100:00100000:0.0:1789403445.142826:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154112 00000100:00100000:0.0:1789403445.142830:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154112 00000100:00100000:0.0:1789403445.142872:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1789403445.142883:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1876325038153856:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789403445.142923:0:19353:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0@192.168.203.43@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1789403445.142997:0:19353:0:(genops.c:1384:class_connect()) connect: client 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0, cookie 0x5fb08b1e5b7621fa 00000004:00100000:0.0:1789403445.143028:0:19353:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789403445.143164:0:19353:0:(import.c:65:import_set_state_nolock()) ffff90a1432eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403445.143249:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2386:x1876325038153856:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 366us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.143257:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1789403445.143278:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1789403445.143284:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1876325038154112:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789403445.143302:0:19353:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0@192.168.203.43@tcp t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1789403445.143328:0:19353:0:(genops.c:1384:class_connect()) connect: client 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0, cookie 0x5fb08b1e5b762201 00000004:00100000:0.0:1789403445.143342:0:19353:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789403445.143434:0:19353:0:(import.c:65:import_set_state_nolock()) ffff90a1432ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403445.143461:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2386:x1876325038154112:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 176us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.143468:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1789403445.148051:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403445.148092:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403445.148131:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403445.148456:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154240 00000100:00100000:3.0:1789403445.148469:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154240 00000100:00100000:3.0:1789403445.148551:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038153984 00000100:00100000:3.0:1789403445.148555:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038153984 00000100:00100000:3.0:1789403445.148581:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154368 00000100:00100000:3.0:1789403445.148584:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154368 00000100:00100000:3.0:1789403445.148609:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:3.0:1789403445.148620:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:0:x1876325038154240:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789403445.148668:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403445.148754:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:0:x1876325038154240:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 135us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403445.148762:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:3.0:1789403445.148782:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1789403445.148788:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+7:0:x1876325038153984:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789403445.148828:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789403445.148871:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+7:0:x1876325038153984:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 82us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403445.148878:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:3.0:1789403445.148890:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1789403445.148897:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038154368:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789403445.148908:0:17225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789403445.148929:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038154368:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403445.148935:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00080000:1.0:1789403445.150146:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403445.150156:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403445.158523:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403445.158701:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154496 00000100:00100000:0.0:1789403445.158715:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154496 00000100:00100000:0.0:1789403445.158791:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:0.0:1789403445.158803:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038154496:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789403445.158927:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038154496:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 126us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403445.158935:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1789403445.166842:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403445.166902:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403445.166941:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403445.167063:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154624 00000100:00100000:3.0:1789403445.167077:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154624 00000100:00100000:3.0:1789403445.167127:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154752 00000100:00100000:3.0:1789403445.167130:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154752 00000100:00100000:3.0:1789403445.167153:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:3.0:1789403445.167163:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2386:x1876325038154624:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789403445.167209:0:19833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0@192.168.203.43@tcp t0 exp 0000000000000000 cur 491 last 0 00000100:00100000:2.0:1789403445.167211:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038154880 00000100:00100000:2.0:1789403445.167216:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038154880 00000020:00000080:3.0:1789403445.167250:0:19833:0:(genops.c:1384:class_connect()) connect: client 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0, cookie 0x5fb08b1e5b762208 00000100:00100000:2.0:1789403445.167257:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00002000:00100000:3.0:1789403445.167265:0:19833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0/ffff90a143337800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789403445.167265:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038154880:12345-192.168.203.43@tcp:900:mount.lustre.0 00002000:00100000:3.0:1789403445.167278:0:19833:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789403445.167366:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038154880:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 102us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403445.167373:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00002000:00080000:3.0:1789403445.167417:0:19833:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789403445.167449:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00080000:3.0:1789403445.167451:0:19833:0:(import.c:65:import_set_state_nolock()) ffff90a143337000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403445.167454:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1876325038154752:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789403445.167470:0:18731:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0@192.168.203.43@tcp t0 exp 0000000000000000 cur 491 last 0 00000100:00100000:3.0:1789403445.167481:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2386:x1876325038154624:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 320us (579us total) trans 0 rc 0/0 00000020:00000080:2.0:1789403445.167489:0:18731:0:(genops.c:1384:class_connect()) connect: client 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0, cookie 0x5fb08b1e5b76220f 00002000:00100000:2.0:1789403445.167494:0:18731:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0/ffff90a14455b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789403445.167500:0:18731:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789403445.167507:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00002000:00080000:2.0:1789403445.167553:0:18731:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789403445.167569:0:18731:0:(import.c:65:import_set_state_nolock()) ffff90a144558800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403445.167594:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2386:x1876325038154752:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 139us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403445.167600:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403445.172125:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403445.172309:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155008 00000100:00100000:3.0:1789403445.172321:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155008 00000100:00100000:3.0:1789403445.172436:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1789403445.172450:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038155008:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789403445.172577:0:17228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789403445.172730:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15016:x1876325038155008:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 282us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403445.172739:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1789403445.390448:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403445.392167:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155136 00000100:00100000:1.0:1789403445.392186:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155136 00000100:00100000:1.0:1789403445.392283:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1789403445.392298:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15051:x1876325038155136:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:1.0:1789403445.392358:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403445.392405:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b762216 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128bcf expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403445.392492:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403445.392511:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403445.392528:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403445.392708:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403445.392713:0:17226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403445.392740:0:17226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403445.392773:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b762216 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 8 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403445.392797:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 7 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403445.392808:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:1.0:1789403445.392812:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403445.392817:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05600, rc 0) 00000100:00100000:1.0:1789403445.392920:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+7:15051:x1876325038155136:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 625us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403445.392929:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:2.0:1789403445.489830:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403445.813266:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789403446.513834:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403447.026894:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403447.026927:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050810240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403447.027024:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403447.027437:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810240 00000100:00100000:0.0:1789403447.027448:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810240 00000100:00100000:0.0:1789403447.027533:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403447.027564:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050810240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403447.027617:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789403447.027688:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050810240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403447.027696:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789403447.027761:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403447.028010:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050810240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789403447.537886:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403447.539744:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050810368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403447.539847:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403447.542320:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050810496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403447.542471:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403447.543705:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810368 00000100:00100000:3.0:1789403447.543720:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810368 00000100:00100000:3.0:1789403447.543854:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810496 00000100:00100000:3.0:1789403447.543858:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810496 00000100:00100000:3.0:1789403447.543878:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403447.543889:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050810368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403447.543939:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789403447.544021:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050810368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403447.544029:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403447.544049:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403447.544055:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050810496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403447.544076:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403447.544223:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050810368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403447.546811:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050810496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2740us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403447.546841:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789403447.556272:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050810496:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1789403447.966342:0:20102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789403448.052723:0:17957:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00100000:3.0:1789403448.052740:0:17957:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000001:00100000:2.0:1789403448.052928:0:17204:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00100000:2.0:1789403448.052937:0:17204:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00010000:00010000:0.0:1789403448.561785:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403448.562239:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789403449.586244:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403449.586276:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050810624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403449.586409:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403449.586592:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810624 00000100:00100000:3.0:1789403449.586602:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810624 00000100:00100000:3.0:1789403449.586667:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403449.586679:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050810624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403449.586717:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403449.586770:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050810624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403449.586778:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403449.587138:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050811008:0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587179:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403449.587210:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050811520:0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587233:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403449.587249:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050812032:0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587277:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403449.587299:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789403449.587305:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050811136:0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587332:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403449.587356:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050811648:0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587376:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403449.587411:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050812160:0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587435:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403449.587467:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811008 00000100:00100000:2.0:1789403449.587474:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811008 00000100:00100000:2.0:1789403449.587507:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811520 00000100:00100000:2.0:1789403449.587510:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811520 00000100:00100000:2.0:1789403449.587539:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789403449.587545:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050811008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587592:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050811008:12345-0@lo:400:kworker.0 Request processed in 47us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403449.587598:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789403449.587616:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789403449.587622:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050811520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587650:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050811520:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403449.587656:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789403449.587679:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050812032 00000100:00100000:2.0:1789403449.587683:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050812032 00000100:00100000:2.0:1789403449.587713:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050812160 00000100:00100000:2.0:1789403449.587716:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050812160 00000100:00100000:2.0:1789403449.587733:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789403449.587740:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050812032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587769:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050812032:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403449.587775:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789403449.587786:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403449.587791:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050812160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.587836:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050812160:12345-0@lo:400:kworker.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403449.587842:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403449.587860:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811136 00000100:00100000:2.0:1789403449.587863:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811136 00000100:00100000:0.0:1789403449.588013:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050811264:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.588049:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588073:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050811776:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.588094:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588110:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050812288:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.588131:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588145:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789403449.588151:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050810880:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.588180:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588205:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050811392:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.588227:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588239:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050811904:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.588259:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588458:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403449.588466:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050812416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403449.588493:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.588520:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050812416 00000100:00100000:0.0:1789403449.588525:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050812416 00000100:00080000:3.0:1789403449.589251:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403449.589258:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403449.589261:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403449.589319:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050810624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403449.589363:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811648 00000100:00100000:3.0:1789403449.589368:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811648 00000100:00100000:2.0:1789403449.589489:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811264 00000100:00100000:2.0:1789403449.589500:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811264 00000100:00100000:2.0:1789403449.589528:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403449.589729:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403449.589737:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050812416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789403449.589768:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789403449.589846:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050812416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.589853:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403449.589886:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403449.589893:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050811264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.589925:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050811264:12345-0@lo:400:kworker.0 Request processed in 32us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.589930:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789403449.589946:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403449.589959:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050810752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403449.590006:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403449.590048:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050812416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403449.590060:0:3628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789403449.590072:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050811264:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590092:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810752 00000100:00100000:0.0:1789403449.590095:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810752 00000100:00100000:0.0:1789403449.590112:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403449.590118:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050810752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403449.590135:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789403449.590167:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050810752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.590174:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403449.590203:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050810752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403449.590484:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811776 00000100:00100000:0.0:1789403449.590489:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811776 00000100:00100000:0.0:1789403449.590509:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050812288 00000100:00100000:0.0:1789403449.590512:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050812288 00000100:00100000:0.0:1789403449.590524:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811392 00000100:00100000:0.0:1789403449.590527:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811392 00000100:00100000:0.0:1789403449.590549:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050811904 00000100:00100000:0.0:1789403449.590552:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050811904 00000100:00100000:0.0:1789403449.590566:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789403449.590571:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050811776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590610:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050811776:12345-0@lo:400:kworker.0 Request processed in 39us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.590616:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789403449.590626:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403449.590631:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050812288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590653:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050812288:12345-0@lo:400:kworker.0 Request processed in 22us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.590658:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403449.590667:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403449.590672:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050811392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590697:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050811392:12345-0@lo:400:kworker.0 Request processed in 25us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.590710:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403449.590722:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789403449.590728:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050811904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590758:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050811904:12345-0@lo:400:kworker.0 Request processed in 30us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403449.590762:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789403449.590837:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050811392:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590850:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050811904:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590860:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050811776:0@lo:400:kworker.0 00010000:00080000:0.0:1789403449.590881:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3ca80 x1876325050812288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403449.590892:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050812288:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590929:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050812160:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590940:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050811008:0@lo:400:kworker.0 00000100:00100000:0.0:1789403449.590951:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050811520:0@lo:400:kworker.0 00010000:00080000:0.0:1789403449.590965:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a246f3d500 x1876325050812032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403449.590974:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050812032:0@lo:400:kworker.0 00000100:00100000:3.0:1789403449.591412:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403449.591422:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050811648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403449.591474:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050811648:12345-0@lo:400:kworker.0 Request processed in 54us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403449.591488:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789403449.591511:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403449.591684:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050811136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.591722:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050811136:12345-0@lo:400:kworker.0 Request processed in 2188us (4390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403449.591729:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403449.591755:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050810880 00000100:00100000:2.0:1789403449.591760:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050810880 00000100:00100000:2.0:1789403449.591833:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789403449.591841:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3628:x1876325050810880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403449.591975:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3628:x1876325050810880:12345-0@lo:400:kworker.0 Request processed in 135us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403449.591982:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1789403449.592058:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403449.592064:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403449.592068:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403449.592071:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403449.592116:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050810880:0@lo:400:kworker.0 00000100:00100000:3.0:1789403449.593539:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050811136:0@lo:400:kworker.0 00000100:00100000:3.0:1789403449.593567:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050811648:0@lo:400:kworker.0 00000100:00100000:3.0:1789403450.440225:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403450.440267:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403450.440307:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403450.440334:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155648 00000100:00100000:3.0:1789403450.440339:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403450.440345:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155648 00000100:00100000:3.0:1789403450.440372:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403450.440425:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403450.440434:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156160 00000100:00100000:2.0:1789403450.440439:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156160 00000100:00100000:3.0:1789403450.440453:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403450.440527:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155392 00000100:00100000:0.0:1789403450.440533:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155392 00000100:00100000:0.0:1789403450.440569:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155904 00000100:00100000:1.0:1789403450.440584:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155520 00000100:00100000:0.0:1789403450.440584:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155904 00000100:00100000:1.0:1789403450.440592:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155520 00000100:00100000:0.0:1789403450.440611:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1789403450.440624:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2389:x1876325038155392:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403450.440631:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1789403450.440641:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038155904:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403450.440694:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2389:x1876325038155392:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 74us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403450.440701:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1789403450.440716:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1789403450.440722:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038155520:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403450.441116:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038155904:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 475us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403450.441124:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:3.0:1789403450.443102:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403450.443495:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403450.444543:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038155520:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3815us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403450.444556:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1789403450.444588:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156032 00000100:00100000:0.0:1789403450.444595:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156032 00000100:00100000:0.0:1789403450.444631:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1789403450.444639:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038156032:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403450.444681:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038156032:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403450.444686:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:2.0:1789403450.445422:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155776 00000100:00100000:2.0:1789403450.445431:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155776 00000100:00100000:2.0:1789403450.445470:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403450.445480:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038155648:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403450.445526:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038155648:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 47us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403450.445544:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403450.445561:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1789403450.445568:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038156160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403450.445602:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038156160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 34us (5264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403450.445609:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1789403450.445621:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1789403450.445627:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038155776:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403450.445649:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038155776:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 22us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403450.447049:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00080000:2.0:1789403450.447081:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403450.447087:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403450.447089:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403450.447092:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403450.447427:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038155264 00000100:00100000:0.0:1789403450.447437:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038155264 00000100:00100000:0.0:1789403450.447485:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1789403450.447495:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2389:x1876325038155264:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403450.447552:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2389:x1876325038155264:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 60us (7180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403450.447558:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:0.0:1789403450.447597:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156288 00000100:00100000:0.0:1789403450.447601:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156288 00000100:00100000:0.0:1789403450.447631:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1789403450.447638:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038156288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403450.447663:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038156288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403450.447669:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00080000:2.0:1789403450.448085:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789403450.614363:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789403451.123605:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00100000:3.0:1789403451.129864:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000020:00000080:1.0:1789403451.322231:0:20249:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd68d4ffc0 20000000:00000080:1.0:1789403451.322249:0:20249:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a277e57800 uarg=0000000000000000 20000000:01000000:1.0:1789403451.322291:0:20249:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789403451.322297:0:20249:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789403451.322301:0:20249:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789403451.322906:0:20250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789403451.323061:0:20249:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789403451.329752:0:20249:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789403451.329883:0:20249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329903:0:20249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 23 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329912:0:20249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 23 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329920:0:20249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 23 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329927:0:20249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329937:0:20249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329945:0:20249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.329952:0:20249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330013:0:20249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330029:0:20249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 12 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.330044:0:20249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812544:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403451.330180:0:20249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330190:0:20249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.330199:0:20249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812672:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403451.330232:0:20249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 23 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330240:0:20249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 23 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.330250:0:20249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812800:0@lo:104: 00000100:00100000:0.0:1789403451.330289:0:20249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403451.330334:0:20249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 23 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330342:0:20249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 23 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.330361:0:20249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812928:0@lo:104: 00000100:00100000:0.0:1789403451.330381:0:20249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403451.330446:0:20249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 23 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330454:0:20249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 23 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.330462:0:20249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050813056:0@lo:104: 00000100:00100000:0.0:1789403451.330481:0:20249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403451.330497:0:20249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 23 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.330505:0:20249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 23 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.330524:0:20249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050813184:0@lo:104: 00000100:00100000:0.0:1789403451.330545:0:20249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403451.330565:0:20249:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a797300 going to sleep for 11 seconds 00000100:00100000:1.0:1789403451.330664:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050812800 00000100:00100000:1.0:1789403451.330673:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050812800 00000100:00100000:1.0:1789403451.330708:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050812928 00000100:00100000:1.0:1789403451.330712:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050812928 00000100:00100000:1.0:1789403451.330722:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813056 00000100:00100000:1.0:1789403451.330724:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813056 00000100:00100000:1.0:1789403451.330731:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813184 00000100:00100000:1.0:1789403451.330734:0:17207:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813184 00000100:00100000:1.0:1789403451.330749:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403451.330757:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+6:20249:x1876325050812800:12345-0@lo:104: 00010000:00010000:1.0:1789403451.330769:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.330833:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403451.330846:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+6:20249:x1876325050812800:12345-0@lo:104: Request processed in 90us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.330853:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403451.330872:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403451.330877:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+5:20249:x1876325050812928:12345-0@lo:104: 00010000:00010000:1.0:1789403451.330885:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.330920:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789403451.330925:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+5:20249:x1876325050812928:12345-0@lo:104: Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.330930:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403451.330943:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403451.330949:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:20249:x1876325050813056:12345-0@lo:104: 00010000:00010000:1.0:1789403451.330955:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.330984:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789403451.330989:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+4:20249:x1876325050813056:12345-0@lo:104: Request processed in 41us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.330994:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403451.331005:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403451.331010:0:17207:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:20249:x1876325050813184:12345-0@lo:104: 00010000:00010000:1.0:1789403451.331017:0:17207:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331041:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789403451.331051:0:17207:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+3:20249:x1876325050813184:12345-0@lo:104: Request processed in 41us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.331057:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789403451.331074:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789403451.331080:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331086:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403451.331090:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331097:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403451.331104:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403451.331109:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403451.331136:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331142:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403451.331162:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331168:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c6c00/0x5fb08b1e5b761f99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761fa0 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331180:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789403451.331183:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331199:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403451.331202:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331208:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403451.331214:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403451.331218:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403451.331232:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331239:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403451.331254:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331261:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c7600/0x5fb08b1e5b761eff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761f06 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331271:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403451.331274:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331279:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403451.331282:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331298:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403451.331304:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403451.331308:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403451.331320:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331325:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403451.331332:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331337:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e8800/0x5fb08b1e5b761ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761ec7 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331346:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403451.331349:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331353:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403451.331355:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331361:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403451.331367:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403451.331377:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403451.331415:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331421:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403451.331427:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331433:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c6e00/0x5fb08b1e5b761eb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b761eb9 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331445:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403451.331447:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403451.331448:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403451.331454:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403451.331459:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403451.331477:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050813312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.331508:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403451.331538:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403451.331544:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050813696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.331564:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403451.331590:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050813440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.331611:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403451.331628:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403451.331633:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050813568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.331649:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403451.331673:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813312 00000100:00100000:1.0:1789403451.331683:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813312 00010000:00010000:1.0:1789403451.331701:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 24 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403451.331715:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813696 00000100:00100000:1.0:1789403451.331717:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813696 00010000:00010000:1.0:1789403451.331726:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 25 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403451.331734:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813440 00000100:00100000:1.0:1789403451.331737:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813440 00010000:00010000:1.0:1789403451.331745:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 26 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403451.331754:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813568 00000100:00100000:1.0:1789403451.331756:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813568 00010000:00010000:1.0:1789403451.331764:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 27 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403451.331775:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403451.331781:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+27:3627:x1876325050813312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403451.331791:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403451.331795:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 27 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331815:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 27 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331831:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403451.331860:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+27:3627:x1876325050813312:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.331866:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403451.331886:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403451.331892:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+26:3627:x1876325050813696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403451.331900:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403451.331904:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 26 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331912:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 26 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331921:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403451.331943:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+26:3627:x1876325050813696:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.331950:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403451.331964:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403451.331969:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+25:3628:x1876325050813440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403451.331976:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403451.331980:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 25 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331987:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 25 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.331997:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403451.332022:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+25:3628:x1876325050813440:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.332027:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403451.332039:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403451.332044:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3628:x1876325050813568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403451.332060:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403451.332065:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 24 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.332072:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 24 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.332080:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403451.332103:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3628:x1876325050813568:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.332109:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403451.332151:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050813568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.332159:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050813440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.332184:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050813696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403451.332191:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050813312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403451.332864:0:20249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8200/0x5fb08b1e5b761fa0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761f99 expref: 23 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.332879:0:20249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812800:0@lo:104: 00010000:00010000:0.0:1789403451.332888:0:20249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b761f06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761eff expref: 22 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.332896:0:20249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812928:0@lo:104: 00010000:00010000:0.0:1789403451.332904:0:20249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e9400/0x5fb08b1e5b761ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761ec0 expref: 21 pid: 17219 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.332921:0:20249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050813056:0@lo:104: 00010000:00010000:0.0:1789403451.332934:0:20249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8600/0x5fb08b1e5b761eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b761eb2 expref: 20 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403451.332941:0:20249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050813184:0@lo:104: 00000100:00100000:0.0:1789403451.345025:0:20249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812544:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403451.345041:0:20249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20249:1876325050812672:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403451.345077:0:20249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403451.349638:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403451.349819:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156416 00000100:00100000:1.0:1789403451.349829:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156416 00010000:00010000:1.0:1789403451.349863:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 13 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403451.349901:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:1.0:1789403451.349910:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2389:x1876325038156416:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403451.349929:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403451.349935:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 13 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.350299:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 13 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.350322:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b7621f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b9e expref: 13 pid: 17218 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.350339:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403451.350577:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:2389:x1876325038156416:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 666us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.350585:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1789403451.352722:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403451.352775:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156544 00000100:00100000:1.0:1789403451.352786:0:17210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156544 00010000:00010000:1.0:1789403451.352841:0:17210:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403451.352883:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1789403451.352892:0:17210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:2390:x1876325038156544:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403451.352906:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403451.352911:0:17210:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.352922:0:17210:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.352936:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e9600/0x5fb08b1e5b7621b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b2e expref: 12 pid: 17217 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.352951:0:17210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.352971:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.352988:0:17210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.352995:0:17210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.353001:0:17210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.353008:0:17210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.353014:0:17210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403451.353018:0:17210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.353026:0:17210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.353046:0:17210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.353059:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403451.353116:0:17210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:2390:x1876325038156544:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 225us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403451.353124:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00010000:00010000:0.0:1789403451.353301:0:20249:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.353310:0:20249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403451.353316:0:20249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762224 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403451.637024:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403452.147053:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050813824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403452.147123:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403452.147178:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813824 00000100:00100000:1.0:1789403452.147185:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813824 00000100:00100000:1.0:1789403452.147237:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403452.147246:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050813824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403452.147274:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789403452.147317:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050813824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403452.147324:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789403452.147344:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403452.147376:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050813824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403452.423714:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403452.423832:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156672 00000100:00100000:3.0:1789403452.423842:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156672 00000100:00100000:3.0:1789403452.423895:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:3.0:1789403452.423905:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:14898:x1876325038156672:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.423921:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403452.423948:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241514000/0x5fb08b1e5b76222b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128bd6 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.423975:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241514000/0x5fb08b1e5b76222b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bd6 expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.423999:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241514000/0x5fb08b1e5b76222b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bd6 expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.424007:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241514000, rc 0) 00000100:00100000:3.0:1789403452.424066:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:14898:x1876325038156672:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 162us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.424071:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 144 00000100:00100000:3.0:1789403452.441646:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403452.441677:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156800 00000100:00100000:1.0:1789403452.441687:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156800 00000100:00100000:1.0:1789403452.441742:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:1.0:1789403452.441752:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:14898:x1876325038156800:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.441900:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:14898:x1876325038156800:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 148us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403452.441909:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:2.0:1789403452.448366:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403452.448552:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038156928 00000100:00100000:3.0:1789403452.448562:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038156928 00000100:00100000:3.0:1789403452.448617:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 146 00000100:00100000:3.0:1789403452.448627:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:14898:x1876325038156928:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.448758:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:14898:x1876325038156928:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 132us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.448767:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 146 10000000:01000000:1.0:1789403452.466506:0:17221:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403452.466515:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144166800 from 13 10000000:01000000:1.0:1789403452.466521:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403452.466565:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.466577:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.466598:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403452.466622:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050813952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.466684:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403452.466722:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.466788:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050813952 00000100:00100000:3.0:1789403452.466806:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050813952 00000100:00100000:3.0:1789403452.466858:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789403452.466867:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:17221:x1876325050813952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.466879:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403452.466891:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b762239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762232 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.466912:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b762239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762232 expref: 21 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.466933:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b762239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762232 expref: 21 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.466942:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241514e00, rc 0) 00000100:00100000:3.0:1789403452.466978:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050813952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.466985:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789403452.467067:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050813952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403452.467092:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.467102:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403452.467163:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.467188:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403452.467213:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.467308:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814080 00000100:00100000:3.0:1789403452.467313:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814080 00000100:00100000:3.0:1789403452.467352:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789403452.467359:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050814080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.467485:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050814080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.467493:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789403452.469259:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.469356:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.469446:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403452.469488:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403452.469505:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814208 00000100:00100000:1.0:1789403452.469519:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814208 00000100:00100000:1.0:1789403452.469571:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789403452.469579:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050814208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.469708:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050814208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403452.469721:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789403452.469791:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403452.470969:0:20303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789403452.472188:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789403452.472217:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403452.472229:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472241:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403452.472252:0:17221:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403452.472254:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a2702b7000 from 13 10000000:01000000:3.0:1789403452.472258:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403452.472292:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472310:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472321:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403452.472344:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.472422:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.472456:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.472474:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814336 00000100:00100000:3.0:1789403452.472480:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814336 00000100:00100000:3.0:1789403452.472516:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789403452.472523:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:17221:x1876325050814336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.472535:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403452.472546:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241515600/0x5fb08b1e5b762247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762240 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472567:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241515600/0x5fb08b1e5b762247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762240 expref: 22 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472578:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241515600/0x5fb08b1e5b762247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762240 expref: 22 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472587:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241515600, rc 0) 00000100:00100000:3.0:1789403452.472620:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050814336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.472626:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789403452.472673:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.472686:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.472694:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403452.472739:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.472761:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.472772:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.472782:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814464 00000100:00100000:3.0:1789403452.472785:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814464 00000100:00100000:3.0:1789403452.472817:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789403452.472823:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050814464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.472909:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050814464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.472915:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789403452.472939:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.472959:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.472993:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.473006:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.473016:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814592 00000100:00100000:3.0:1789403452.473020:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814592 00000100:00100000:3.0:1789403452.473039:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789403452.473046:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050814592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.473190:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050814592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.473202:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789403452.473239:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789403452.473874:0:20304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789403452.473930:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789403452.473944:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403452.473951:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.473960:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403452.474014:0:17221:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403452.474016:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a281b17800 from 13 10000000:01000000:3.0:1789403452.474019:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403452.474041:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.474048:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.474057:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403452.474073:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.474792:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.474834:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.474852:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814720 00000100:00100000:3.0:1789403452.474858:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814720 00000100:00100000:3.0:1789403452.474904:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789403452.474911:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1437f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:17221:x1876325050814720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.474924:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403452.474936:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a241515400/0x5fb08b1e5b762255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76224e expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.474957:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a241515400/0x5fb08b1e5b762255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76224e expref: 23 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.474968:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a241515400/0x5fb08b1e5b762255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76224e expref: 23 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.474976:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a241515400, rc 0) 00000100:00100000:3.0:1789403452.475008:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1437f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050814720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.475014:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789403452.475066:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.475089:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.475099:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403452.475154:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.475178:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.475191:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.475204:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814848 00000100:00100000:3.0:1789403452.475207:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814848 00000100:00100000:3.0:1789403452.475235:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789403452.475241:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050814848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.475342:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050814848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.475348:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789403452.475377:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.475419:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.475456:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.475469:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403452.475479:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050814976 00000100:00100000:3.0:1789403452.475483:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050814976 00000100:00100000:3.0:1789403452.475503:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789403452.475509:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050814976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.475576:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050814976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.475582:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789403452.475621:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050814976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403452.479964:0:20305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789403452.480272:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789403452.480296:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403452.480307:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.480330:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403452.480342:0:17221:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403452.480357:0:17221:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a14452d000 from 13 10000000:01000000:3.0:1789403452.480360:0:17221:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403452.480420:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.480428:0:17221:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.480441:0:17221:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403452.480467:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050815104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403452.480532:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403452.480574:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403452.480683:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050815104 00000100:00100000:1.0:1789403452.480691:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050815104 00000100:00100000:1.0:1789403452.480740:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789403452.480750:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:17221:x1876325050815104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403452.480764:0:17218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403452.480777:0:17218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b762263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76225c expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.480812:0:17218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b762263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76225c expref: 24 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.480821:0:17218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b762263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76225c expref: 24 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.480828:0:17218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04000, rc 0) 00000100:00100000:1.0:1789403452.480870:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050815104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403452.480876:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789403452.480920:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050815104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403452.480934:0:17221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.480942:0:17221:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403452.481097:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050815232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.481123:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403452.481138:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27045e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403452.481151:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050815232 00000100:00100000:1.0:1789403452.481155:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050815232 00000100:00100000:1.0:1789403452.481176:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789403452.481181:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050815232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.481313:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050815232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403452.481320:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789403452.481382:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050815232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.481451:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050815360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.481493:0:17221:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403452.481507:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27045e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403452.481518:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050815360 00000100:00100000:1.0:1789403452.481521:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050815360 00000100:00100000:1.0:1789403452.481557:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789403452.481563:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050815360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403452.481655:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:17221:x1876325050815360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403452.481662:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789403452.481703:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:41b7c44b-9a12-452a-b9e6-b5b285399ec4:17221:1876325050815360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403452.482652:0:20307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789403452.482711:0:17221:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789403452.482731:0:17221:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403452.482739:0:17221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403452.482750:0:17221:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403452.485697:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403452.488027:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157056 00000100:00100000:2.0:1789403452.488040:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157056 00000100:00100000:3.0:1789403452.488470:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:3.0:1789403452.488482:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:14898:x1876325038157056:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403452.488499:0:17219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403452.488518:0:17219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a1425c6e00/0x5fb08b1e5b76226a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128bdd expref: -99 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.488545:0:17219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a1425c6e00/0x5fb08b1e5b76226a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bdd expref: 13 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.488556:0:17219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a1425c6e00/0x5fb08b1e5b76226a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bdd expref: 13 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403452.488565:0:17219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6e00, rc 0) 00000100:00100000:3.0:1789403452.488629:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:14898:x1876325038157056:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 149us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403452.488646:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 159 00000100:00100000:3.0:1789403452.503670:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403452.504075:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157184 00000100:00100000:0.0:1789403452.504085:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157184 00000100:00100000:0.0:1789403452.504134:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:0.0:1789403452.504143:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:14898:x1876325038157184:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403452.504281:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:14898:x1876325038157184:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 138us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403452.504289:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 160 00000100:00100000:0.0:1789403452.518820:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403452.518967:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157312 00000100:00100000:2.0:1789403452.518978:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157312 00000100:00100000:2.0:1789403452.519065:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:2.0:1789403452.519076:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:14898:x1876325038157312:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403452.519215:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:14898:x1876325038157312:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 140us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403452.519223:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 161 00000100:00100000:1.0:1789403452.657672:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403452.657695:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050815488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403452.657767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403452.657857:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050815488 00000100:00100000:2.0:1789403452.657866:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050815488 00000100:00100000:2.0:1789403452.657917:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789403452.657926:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050815488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403452.657958:0:19382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789403452.658006:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050815488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403452.658013:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789403452.658093:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050815488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403452.659856:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403452.660255:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050815616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403452.660312:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403452.660421:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050815616 00000100:00100000:2.0:1789403452.660429:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050815616 00000100:00100000:2.0:1789403452.660467:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789403452.660476:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050815616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403452.660515:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403452.660565:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050815616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403452.660572:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789403452.660613:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050815616:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789403453.682007:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403454.524028:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.524549:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157440 00000100:00100000:0.0:1789403454.524559:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157440 00000100:00080000:2.0:1789403454.524617:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403454.524633:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1789403454.524645:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:15568:x1876325038157440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403454.524666:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403454.524688:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762271 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128be4 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524750:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524764:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524788:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524804:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524812:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524819:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524900:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b762286 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524909:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b762286 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.524930:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b762286 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403454.524961:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403454.524965:0:17224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403454.525001:0:17224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b762286 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525013:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525020:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525026:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525033:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403454.525037:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525045:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525057:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:0.0:1789403454.525061:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403454.525066:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525072:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b762278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525096:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525101:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525106:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525111:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403454.525114:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525120:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525128:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a27c1d4300) 00010000:00010000:0.0:1789403454.525131:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403454.525134:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525140:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b76227f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525171:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762271 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128be4 expref: 8 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525184:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b762286 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128be4 expref: 7 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.525201:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a27c1d4a00) 00010000:00010000:0.0:1789403454.525203:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403454.525205:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9600, rc 0) 00000100:00100000:0.0:1789403454.525272:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:15568:x1876325038157440:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 630us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.525279:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403454.527684:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.527771:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157568 00000100:00100000:2.0:1789403454.527789:0:17235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157568 00000100:00100000:2.0:1789403454.527893:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1789403454.527905:0:17235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:15568:x1876325038157568:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789403454.528009:0:17235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:15568:x1876325038157568:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403454.528017:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:2.0:1789403454.550546:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.550949:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157824 00000100:00100000:0.0:1789403454.550960:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157824 00000100:00100000:0.0:1789403454.551020:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1789403454.551030:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:15568:x1876325038157824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403454.551050:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403454.551070:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76228d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128beb expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551147:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551161:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551172:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551185:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551192:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551209:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551308:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7622a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551316:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7622a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.551323:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7622a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789403454.551330:0:17226:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000004:00200000:0.0:1789403454.562066:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789403454.562752:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562764:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562772:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562788:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403454.562793:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562802:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562826:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a27c1d4a00) 00010000:00010000:1.0:1789403454.562829:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403454.562834:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562841:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b762294 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562856:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562862:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562867:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.562872:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403454.563283:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.563294:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.563303:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a27c1d4300) 00010000:00010000:1.0:1789403454.563305:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403454.563308:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.563315:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b76229b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.567580:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76228d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128beb expref: 10 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.567609:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7622a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128beb expref: 9 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.567619:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a27c1d4700) 00010000:00010000:1.0:1789403454.567622:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403454.567625:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8800, rc 0) 00000100:00100000:1.0:1789403454.567700:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15568:x1876325038157824:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 16670us (17162us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789403454.567710:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1789403454.590772:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.593796:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038157952 00000100:00100000:3.0:1789403454.593811:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038157952 00000100:00100000:3.0:1789403454.593880:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403454.593892:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15574:x1876325038157952:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403454.593921:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403454.597412:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128bf2 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597500:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597514:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597528:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597544:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597551:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597558:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597600:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597618:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597624:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597630:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403454.597634:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597641:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597654:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:3.0:1789403454.597657:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403454.597673:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597681:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b7622b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597696:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597702:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597707:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597712:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403454.597721:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597728:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597736:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a1434a8d00) 00010000:00010000:3.0:1789403454.597738:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403454.597741:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597746:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b7622be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597790:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bf2 expref: 10 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597800:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:3.0:1789403454.597802:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403454.597806:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bf2 expref: 10 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.597816:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7600, rc 0) 00000100:00100000:3.0:1789403454.600490:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15574:x1876325038157952:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 6589us (9715us total) trans 0 rc 301/301 00000100:00100000:3.0:1789403454.600503:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1789403454.600551:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.600974:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158080 00000100:00100000:3.0:1789403454.600983:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158080 00000100:00100000:3.0:1789403454.601031:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:3.0:1789403454.601042:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15568:x1876325038158080:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789403454.601217:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15568:x1876325038158080:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 177us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.601224:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1789403454.607671:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.607763:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158208 00000100:00100000:2.0:1789403454.607773:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158208 00000100:00100000:2.0:1789403454.607859:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1789403454.607870:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:15568:x1876325038158208:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789403454.608425:0:17224:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 516us 00000100:00080000:3.0:1789403454.610503:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403454.610770:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.610906:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158336 00000100:00100000:3.0:1789403454.610915:0:17233:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158336 00000100:00100000:3.0:1789403454.610971:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403454.610981:0:17233:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15574:x1876325038158336:12345-192.168.203.43@tcp:700:lfs.0 00000100:00100000:3.0:1789403454.611058:0:17233:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15574:x1876325038158336:12345-192.168.203.43@tcp:700:lfs.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.611065:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403454.622574:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.625134:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158592 00000100:00100000:2.0:1789403454.625150:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158592 00000100:00100000:2.0:1789403454.625218:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:2.0:1789403454.625230:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:15574:x1876325038158592:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:2.0:1789403454.625284:0:19353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403454.625313:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b7621de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b5f expref: 9 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.625332:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:2.0:1789403454.625336:0:19353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403454.625415:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.625430:0:19353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 5 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.625450:0:19353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.625480:0:19353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 5 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.625493:0:19353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 5 pid: 17226 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403454.625506:0:19353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19353:1876325050815744:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403454.625587:0:19353:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403454.632447:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.632491:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158720 00000100:00100000:2.0:1789403454.632499:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158720 00010000:00010000:2.0:1789403454.632553:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 6 pid: 17226 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403454.632586:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1789403454.632596:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038158720:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403454.632611:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403454.632617:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 6 pid: 17226 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.632630:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 6 pid: 17226 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.632672:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:2.0:1789403454.632679:0:17209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.632679:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b76221d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bcf expref: 6 pid: 17226 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.632701:0:17209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403454.632709:0:19353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19353:1876325050815744:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403454.632712:0:17209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.632731:0:19353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.632733:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403454.632744:0:19353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.632751:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.632773:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403454.632796:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038158720:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 198us (354us total) trans 0 rc 0/0 00010000:00010000:0.0:1789403454.632801:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403454.632808:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:0.0:1789403454.632814:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789403454.632834:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403454.633743:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:15568:x1876325038158208:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 25870us (26077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403454.633755:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00010000:00010000:0.0:1789403454.638136:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638157:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638170:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403454.638189:0:19353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9a54b15 reply state 00000000878deac9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638200:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638208:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:0.0:1789403454.638211:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403454.638215:0:19353:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789403454.638221:0:19353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789403454.638229:0:19353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638235:0:19353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638241:0:19353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638254:0:19353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403454.638259:0:19353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638266:0:19353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638277:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a142512b00) 00010000:00010000:0.0:1789403454.638280:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403454.638284:0:19353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638289:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b7622c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403454.638306:0:19353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9a54b15 reply state 00000000878deac9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638315:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.638321:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a27c1d4100) 00010000:00010000:0.0:1789403454.638323:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403454.638325:0:19353:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789403454.638435:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+10:15574:x1876325038158592:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 13204us (15866us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789403454.638444:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:0.0:1789403454.705599:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050815872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403454.705688:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.705745:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050816384:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.705789:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.705811:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050816896:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.705838:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.705858:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050817408:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.705896:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.705916:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789403454.705922:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050816000:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.705950:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.705985:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050816512:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706014:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.706043:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050817024:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706049:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817408 00000100:00100000:3.0:1789403454.706057:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817408 00000100:00100000:0.0:1789403454.706067:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789403454.706086:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403454.706090:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050817536:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706116:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403454.706130:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816512 00000100:00100000:3.0:1789403454.706135:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816512 00000100:00100000:0.0:1789403454.706146:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816000 00000100:00100000:0.0:1789403454.706152:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816000 00000100:00100000:3.0:1789403454.706153:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817024 00000100:00100000:3.0:1789403454.706159:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817024 00000100:00100000:3.0:1789403454.706188:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817536 00000100:00100000:3.0:1789403454.706192:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817536 00000100:00100000:0.0:1789403454.706194:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789403454.706205:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3626:x1876325050816000:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789403454.706210:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403454.706232:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403454.706242:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706259:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3626:x1876325050816000:12345-0@lo:400:kworker.0 Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.706267:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789403454.706292:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050817408:12345-0@lo:400:kworker.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.706300:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789403454.706307:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403454.706316:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050816512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706333:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403454.706352:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050816512:12345-0@lo:400:kworker.0 Request processed in 36us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.706361:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050817024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706370:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403454.706411:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789403454.706419:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050817536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706435:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050817024:12345-0@lo:400:kworker.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.706443:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403454.706459:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050817536:12345-0@lo:400:kworker.0 Request processed in 40us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.706467:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789403454.706492:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816384 00000100:00100000:3.0:1789403454.706500:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816384 00000100:00100000:3.0:1789403454.706551:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816896 00000100:00100000:3.0:1789403454.706555:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816896 00000100:00100000:3.0:1789403454.706588:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403454.706600:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050816384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706618:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403454.706628:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050816896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706675:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050816896:12345-0@lo:400:kworker.0 Request processed in 50us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.706682:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403454.706692:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050816384:12345-0@lo:400:kworker.0 Request processed in 92us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.706702:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403454.706726:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050816000:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706737:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050816256:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706744:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050816512:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706758:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050817024:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789403454.706773:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281913b80 x1876325050817536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403454.706799:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050817536:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706803:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050816768:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706814:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050817408:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706827:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050816384:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706835:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.706842:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050816896:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706863:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050817280:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.706889:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403454.706907:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816256 00000100:00100000:3.0:1789403454.706909:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050817792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403454.706919:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816256 00000100:00100000:3.0:1789403454.706934:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403454.706955:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789403454.706955:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816768 00000100:00100000:0.0:1789403454.706960:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816768 00000100:00100000:3.0:1789403454.706966:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050816128:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.706982:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403454.706990:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050816256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.707003:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403454.707038:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050816640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403454.707129:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050815872 00000100:00100000:1.0:1789403454.707135:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050815872 00000100:00100000:1.0:1789403454.707156:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817792 00000100:00100000:1.0:1789403454.707159:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817792 00000040:00080000:2.0:1789403454.707171:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789403454.707173:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403454.707180:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050815872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403454.707201:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789403454.707563:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403454.707574:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050816768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.708862:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050816256:12345-0@lo:400:kworker.0 Request processed in 1861us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.708874:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789403454.708923:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789403454.708928:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403454.709042:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816128 00000100:00100000:0.0:1789403454.709051:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816128 00000100:00100000:0.0:1789403454.709107:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403454.709115:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a250e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050816128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.709182:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a250e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050816128:12345-0@lo:400:kworker.0 Request processed in 69us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.709188:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789403454.709210:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403454.709330:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403454.709373:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050817152:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.709431:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403454.709458:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050817664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403454.709489:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403454.709529:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050816256:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.709557:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050816128:0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.709583:0:18735:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789403454.709593:0:18735:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789403454.709635:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817280 00000100:00100000:3.0:1789403454.709640:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817280 00000100:00100000:3.0:1789403454.709687:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817152 00000100:00100000:3.0:1789403454.709691:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817152 00000100:00100000:3.0:1789403454.709718:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403454.709725:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050817280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.709762:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050817280:12345-0@lo:400:kworker.0 Request processed in 37us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.709769:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403454.709799:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789403454.709807:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050817152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403454.709843:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050817152:12345-0@lo:400:kworker.0 Request processed in 38us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.709850:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789403454.709870:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403454.709873:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403454.709902:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050817152:0@lo:400:kworker.0 00010000:00080000:3.0:1789403454.709919:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281910000 x1876325050817280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403454.709943:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050817280:0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.711335:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050816640 00000100:00100000:0.0:1789403454.711347:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050816640 00000100:00100000:0.0:1789403454.711406:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403454.711415:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050816640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403454.711483:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050816640:12345-0@lo:400:kworker.0 Request processed in 69us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.711489:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789403454.711529:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050816640:0@lo:400:kworker.0 00000100:00100000:1.0:1789403454.712982:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050815872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5795us (7289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403454.712995:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403454.713020:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050817664 00000100:00100000:1.0:1789403454.713026:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050817664 00000100:00100000:1.0:1789403454.713049:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403454.713056:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050817792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403454.713107:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789403454.713159:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050817792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (6225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403454.713165:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789403454.713191:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403454.713198:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050817664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403454.713207:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789403454.713232:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050817664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403454.713237:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403454.713297:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050817664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403454.713313:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050817792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403454.713554:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050815872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403454.714292:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050816768:12345-0@lo:400:kworker.0 Request processed in 6718us (7456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403454.714304:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403454.716598:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050816768:0@lo:400:kworker.0 00000100:00100000:2.0:1789403454.742911:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.743007:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158848 00000100:00100000:3.0:1789403454.743017:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158848 00000100:00100000:3.0:1789403454.743150:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1789403454.743162:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+10:15582:x1876325038158848:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:3.0:1789403454.743187:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403454.743208:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7622da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128bf9 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.743272:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.743286:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.743298:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403454.743344:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403454.743348:0:17224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403454.743430:0:17224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.743456:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7622da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bf9 expref: 12 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.743475:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bf9 expref: 11 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.743503:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:3.0:1789403454.743505:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403454.743509:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7600, rc 0) 00000100:00100000:3.0:1789403454.743573:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+11:15582:x1876325038158848:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 413us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.743580:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:0.0:1789403454.767374:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.767467:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038158976 00000100:00100000:3.0:1789403454.767493:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038158976 00000100:00100000:3.0:1789403454.767585:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403454.767608:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:15583:x1876325038158976:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403454.767634:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403454.767662:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7622e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c00 expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.767837:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b7622ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.767874:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b7622ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.767887:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b7622ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403454.767935:0:19353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789403454.767939:0:19353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403454.767962:0:19353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b7622ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.767991:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7200/0x5fb08b1e5b7622e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c00 expref: 7 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.768011:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b7622ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c00 expref: 6 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.768021:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:2.0:1789403454.768024:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403454.768028:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184a00, rc 0) 00000100:00100000:2.0:1789403454.768092:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15583:x1876325038158976:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 496us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403454.768101:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403454.770838:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.770920:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038159104 00000100:00100000:0.0:1789403454.770934:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038159104 00000100:00100000:0.0:1789403454.771010:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1789403454.771021:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:15583:x1876325038159104:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403454.771040:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403454.771058:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7622f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c07 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771119:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771132:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771205:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771217:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771225:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771231:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771303:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76230b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771312:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76230b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771334:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76230b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403454.771373:0:17225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403454.771377:0:17225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403454.771423:0:17225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76230b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771437:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771443:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771450:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771455:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403454.771460:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771468:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771479:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:0.0:1789403454.771482:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403454.771487:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771493:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b7622fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771516:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771522:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771528:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771533:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403454.771536:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771542:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771556:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a27c1d4100) 00010000:00010000:0.0:1789403454.771559:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403454.771562:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771567:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771594:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b7622f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c07 expref: 8 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771606:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76230b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c07 expref: 7 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.771622:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:0.0:1789403454.771625:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403454.771627:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8e00, rc 0) 00000100:00100000:0.0:1789403454.771707:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+7:15583:x1876325038159104:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 687us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.771714:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1789403454.775207:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.777582:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038159232 00000100:00100000:0.0:1789403454.777598:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038159232 00000100:00080000:3.0:1789403454.777880:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403454.778914:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403454.778937:0:17235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:15583:x1876325038159232:12345-192.168.203.43@tcp:900:lfs.0 00000100:00100000:3.0:1789403454.779025:0:17235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:15583:x1876325038159232:12345-192.168.203.43@tcp:900:lfs.0 Request processed in 101us (3826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403454.779031:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1789403454.804913:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.805344:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038159488 00000100:00100000:3.0:1789403454.805921:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038159488 00000100:00100000:2.0:1789403454.807623:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1789403454.807639:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+7:15583:x1876325038159488:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403454.807659:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403454.807701:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c0e expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403454.807815:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789403454.808028:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762312 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c0e expref: 9 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.808043:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:2.0:1789403454.808046:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403454.808051:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c0e expref: 9 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.808065:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185000, rc 0) 00000100:00100000:2.0:1789403454.808143:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+8:15583:x1876325038159488:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 509us (3237us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789403454.808150:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:2.0:1789403454.816665:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.816799:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038159744 00000100:00100000:0.0:1789403454.816810:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038159744 00000100:00100000:0.0:1789403454.816875:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1789403454.816886:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+8:15583:x1876325038159744:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:0.0:1789403454.816937:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403454.816967:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b76230b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c07 expref: 8 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.816986:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:0.0:1789403454.816991:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403454.817012:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.817024:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.817034:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403454.817232:0:17225:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d29a6c5 reply state 0000000098d39a8d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.817585:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.817592:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:0.0:1789403454.817595:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789403454.817598:0:17225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789403454.817606:0:17225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789403454.817863:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+9:15583:x1876325038159744:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 978us (1207us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789403454.817871:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:3.0:1789403454.820009:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.820565:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038160000 00000100:00100000:0.0:1789403454.820574:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038160000 00000100:00100000:0.0:1789403454.820618:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1789403454.820627:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+9:15583:x1876325038160000:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1789403454.821968:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+10:15583:x1876325038160000:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 1335us (1959us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789403454.821978:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1789403454.830812:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.831334:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038160256 00000100:00100000:2.0:1789403454.831349:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038160256 00000100:00100000:2.0:1789403454.831870:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:2.0:1789403454.831883:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+10:15583:x1876325038160256:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403454.831908:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403454.831929:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c15 expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832002:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832036:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832049:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832061:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832068:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832074:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403454.832183:0:17226:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613255681 00000004:00200000:2.0:1789403454.832189:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789403454.832477:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832486:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832493:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832499:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403454.832508:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832515:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832535:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:2.0:1789403454.832538:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403454.832543:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832550:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b76232e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832563:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832570:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832576:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832581:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403454.832584:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832589:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832597:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a27c1d4100) 00010000:00010000:2.0:1789403454.832599:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403454.832603:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832608:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762335 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832655:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762327 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c15 expref: 12 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832665:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:2.0:1789403454.832668:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403454.832671:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c15 expref: 12 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403454.832681:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184600, rc 0) 00000100:00100000:2.0:1789403454.832762:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+11:15583:x1876325038160256:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 881us (1965us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789403454.832770:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1789403454.837363:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.837508:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038160384 00000100:00100000:0.0:1789403454.837523:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038160384 00000100:00100000:0.0:1789403454.837597:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:0.0:1789403454.837611:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+11:15583:x1876325038160384:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403454.837633:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403454.837653:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762343 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c1c expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.837749:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.837788:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.837800:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403454.837827:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789403454.837831:0:17224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403454.837854:0:17224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.837880:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762343 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 13 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.837898:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 12 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.837906:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:0.0:1789403454.837909:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403454.837912:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8a00, rc 0) 00000100:00100000:0.0:1789403454.837981:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:15583:x1876325038160384:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 371us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403454.837988:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:3.0:1789403454.846376:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.847379:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038160512 00000100:00100000:2.0:1789403454.847466:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038160512 00000100:00100000:2.0:1789403454.847671:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1789403454.847682:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:15583:x1876325038160512:12345-192.168.203.43@tcp:37:lfs.0 00000100:00100000:2.0:1789403454.854360:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:15583:x1876325038160512:12345-192.168.203.43@tcp:37:lfs.0 Request processed in 6669us (7982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403454.854376:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1789403454.860637:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.861430:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038160768 00000100:00100000:0.0:1789403454.861441:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038160768 00000100:00100000:0.0:1789403454.861511:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:0.0:1789403454.861522:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27db09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:15583:x1876325038160768:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1789403454.861725:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27db09850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+13:15583:x1876325038160768:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 204us (1095us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789403454.861746:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1789403454.929941:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.931355:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038160896 00000100:00100000:0.0:1789403454.931369:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038160896 00000100:00100000:1.0:1789403454.931588:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1789403454.931599:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+11:15589:x1876325038160896:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:1.0:1789403454.931630:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403454.931660:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b762351 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c23 expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931723:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931736:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931762:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931789:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931797:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931804:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931886:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b762366 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931895:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b762366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931902:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b762366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403454.931937:0:19353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403454.931940:0:19353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403454.931975:0:19353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b762366 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931986:0:19353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.931991:0:19353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932007:0:19353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932014:0:19353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403454.932017:0:19353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932025:0:19353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932036:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:1.0:1789403454.932039:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403454.932044:0:19353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932050:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932064:0:19353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932071:0:19353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932076:0:19353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932080:0:19353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403454.932083:0:19353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932099:0:19353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932107:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a27c1d4100) 00010000:00010000:1.0:1789403454.932110:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403454.932113:0:19353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932118:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04800/0x5fb08b1e5b76235f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932143:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04600/0x5fb08b1e5b762351 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c23 expref: 13 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932155:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b762366 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c23 expref: 12 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.932161:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:1.0:1789403454.932163:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789403454.932165:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062000, rc 0) 00000100:00100000:1.0:1789403454.932234:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+12:15589:x1876325038160896:12345-192.168.203.43@tcp:101:bash.0 Request processed in 636us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403454.932241:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1789403454.936149:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403454.936246:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038161024 00000100:00100000:2.0:1789403454.936257:0:17236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038161024 00000100:00100000:2.0:1789403454.936354:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1789403454.936366:0:17236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:15589:x1876325038161024:12345-192.168.203.43@tcp:900:bash.0 00000100:00100000:2.0:1789403454.936480:0:17236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:15589:x1876325038161024:12345-192.168.203.43@tcp:900:bash.0 Request processed in 117us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403454.936517:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403454.938978:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403454.939069:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038161280 00000100:00100000:0.0:1789403454.939082:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038161280 00000100:00100000:0.0:1789403454.939141:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1789403454.939150:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+12:15589:x1876325038161280:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:0.0:1789403454.939167:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403454.939186:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76236d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c2a expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.939281:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.939296:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 12 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.939306:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.939339:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 12 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403454.939352:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 12 pid: 17224 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403454.939363:0:17224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17224:1876325050817920:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403454.939482:0:17224:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403454.943079:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403454.943142:0:17224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17224:1876325050817920:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403454.943196:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403454.943197:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038161408 00000100:00100000:1.0:1789403454.943208:0:17210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038161408 00010000:00010000:1.0:1789403454.943252:0:17210:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 13 pid: 17224 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403454.943312:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403454.943321:0:17210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+13:2389:x1876325038161408:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403454.943336:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403454.943344:0:17210:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 13 pid: 17224 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.943357:0:17210:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 13 pid: 17224 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.943378:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b76234a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c1c expref: 13 pid: 17224 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.943423:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:1.0:1789403454.943429:0:17210:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.943438:0:17210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.943445:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403454.943471:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403454.943532:0:17210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:2389:x1876325038161408:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 211us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403454.943544:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00010000:00010000:3.0:1789403454.943559:0:17224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.943571:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.943605:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.943628:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.943639:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.944896:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.944914:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.944925:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403454.944952:0:17224:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2749852811842 00000004:00200000:3.0:1789403454.944960:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:3.0:1789403454.945275:0:17224:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2749852811842 00010000:00010000:3.0:1789403454.963812:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963835:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963845:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963853:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403454.963858:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963867:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963888:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:3.0:1789403454.963892:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403454.963898:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963905:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b762374 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789403454.963927:0:17224:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018b6426b reply state 00000000edf988fc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.963943:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.967064:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90a1434a8200) 00010000:00010000:3.0:1789403454.967070:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789403454.967078:0:17224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789403454.967168:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76236d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 15 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.967212:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 14 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403454.967222:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:3.0:1789403454.967224:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789403454.967227:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6c00, rc 0) 00000100:00100000:3.0:1789403454.967330:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+15:15589:x1876325038161280:12345-192.168.203.43@tcp:101:bash.0 Request processed in 28178us (28381us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789403454.967341:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:0.0:1789403455.009772:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.010265:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038161536 00000100:00100000:2.0:1789403455.010278:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038161536 00000100:00100000:2.0:1789403455.010362:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:2.0:1789403455.010374:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+15:15589:x1876325038161536:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403455.010551:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403455.010580:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762390 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c31 expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.010743:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.010761:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.010787:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403455.010856:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789403455.010861:0:17226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403455.010890:0:17226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.010903:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.010933:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762390 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 17 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.010956:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 16 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.011223:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403455.011227:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403455.011232:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185800, rc 0) 00000100:00100000:2.0:1789403455.011357:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:15589:x1876325038161536:12345-192.168.203.43@tcp:101:bash.0 Request processed in 984us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403455.011365:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:1.0:1789403455.014807:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.014935:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038161792 00000100:00100000:0.0:1789403455.014947:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038161792 00000100:00100000:0.0:1789403455.015164:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1789403455.015176:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:15589:x1876325038161792:12345-192.168.203.43@tcp:35:bash.0 00000001:00080000:0.0:1789403455.015500:0:17227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:0.0:1789403455.015684:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+18:15589:x1876325038161792:12345-192.168.203.43@tcp:35:bash.0 Request processed in 510us (890us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789403455.015692:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000020:00080000:0.0:1789403455.015698:0:17227:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789403455.027333:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789403455.104328:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403455.104451:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038162048 00000100:00100000:3.0:1789403455.104464:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038162048 00000100:00100000:3.0:1789403455.104558:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1789403455.104570:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+18:15599:x1876325038162048:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403455.104799:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403455.104828:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b76239e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c38 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403455.104975:0:17225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789403455.105112:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b76239e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c38 expref: 20 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.105151:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:3.0:1789403455.105155:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403455.105161:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b76239e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c38 expref: 20 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.105180:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6a00, rc 0) 00000100:00100000:3.0:1789403455.105265:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+19:15599:x1876325038162048:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 697us (953us total) trans 8589934603 rc 301/301 00000100:00100000:3.0:1789403455.105274:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1789403455.118257:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.118881:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038162304 00000100:00100000:2.0:1789403455.118895:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038162304 00000100:00100000:2.0:1789403455.118970:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1789403455.118983:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+19:15599:x1876325038162304:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1789403455.119285:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15599:x1876325038162304:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 305us (1041us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789403455.119293:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:1.0:1789403455.151564:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.151852:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038162560 00000100:00100000:2.0:1789403455.151866:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038162560 00000100:00100000:2.0:1789403455.151950:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:2.0:1789403455.151964:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15602:x1876325038162560:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403455.152006:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403455.152034:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c3f expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.152179:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7623b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.152196:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7623b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.152228:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7623b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403455.152241:0:19353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:2.0:1789403455.152252:0:19353:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133185 00010000:00010000:2.0:1789403455.152386:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c3f expref: 23 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.152464:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7623b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c3f expref: 22 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.152474:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403455.152477:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403455.152493:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185a00, rc 0) 00000100:00100000:2.0:1789403455.153971:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15602:x1876325038162560:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1990us (2402us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789403455.153985:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:0.0:1789403455.162200:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.162309:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403455.162713:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038162816 00000100:00100000:3.0:1789403455.162726:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038162816 00000100:00100000:3.0:1789403455.162810:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:3.0:1789403455.162822:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15602:x1876325038162816:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:3.0:1789403455.162908:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.162930:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.162944:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163000:0:17224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163008:0:17224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163034:0:17224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163040:0:17224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403455.163046:0:17224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163055:0:17224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163069:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:3.0:1789403455.163072:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403455.163078:0:17224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.163085:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403455.163179:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15602:x1876325038162816:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 358us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403455.163188:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:0.0:1789403455.165528:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403455.165649:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038163072 00000100:00100000:3.0:1789403455.165663:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038163072 00000100:00100000:3.0:1789403455.165728:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403455.165740:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15602:x1876325038163072:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1789403455.166166:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038162688 00000100:00100000:2.0:1789403455.166173:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038162688 00000100:00100000:2.0:1789403455.166225:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1789403455.166234:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:2387:x1876325038162688:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403455.166248:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403455.166277:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b7623b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c3f expref: 24 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.166297:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403455.166303:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403455.166412:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+23:2387:x1876325038162688:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 178us (4226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403455.166421:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403455.166587:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15602:x1876325038163072:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 849us (1070us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789403455.166594:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1789403455.401294:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.401427:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038163328 00000100:00100000:0.0:1789403455.401441:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038163328 00000100:00100000:0.0:1789403455.401528:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1789403455.401541:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15633:x1876325038163328:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1789403455.401572:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403455.401694:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7623c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c46 expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.401852:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b7623cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.401870:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b7623cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.401903:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b7623cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403455.401918:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:0.0:1789403455.401929:0:17226:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:0.0:1789403455.402082:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b7623c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c46 expref: 25 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.402105:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b7623cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c46 expref: 24 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.402115:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403455.402118:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403455.402122:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9400, rc 0) 00000100:00100000:0.0:1789403455.402318:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:15633:x1876325038163328:12345-192.168.203.43@tcp:101:cat.0 Request processed in 778us (1037us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789403455.402327:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1789403455.408368:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.408553:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403455.408912:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038163712 00000100:00100000:1.0:1789403455.408926:0:17210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038163712 00000100:00100000:1.0:1789403455.409088:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1789403455.409102:0:17210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:2390:x1876325038163712:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403455.409122:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403455.409155:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b7623cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c46 expref: 24 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.409180:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403455.409187:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403455.409258:0:17210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+23:2390:x1876325038163712:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 159us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403455.409267:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1789403455.410354:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038163584 00000100:00100000:2.0:1789403455.410368:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038163584 00000100:00100000:2.0:1789403455.410436:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403455.410446:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+23:15633:x1876325038163584:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:2.0:1789403455.410840:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:15633:x1876325038163584:12345-192.168.203.43@tcp:35:cat.0 Request processed in 395us (2485us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789403455.410848:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:0.0:1789403455.469300:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403455.469445:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038163968 00000100:00100000:3.0:1789403455.469459:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038163968 00000100:00100000:3.0:1789403455.469536:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:3.0:1789403455.469549:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:15639:x1876325038163968:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1789403455.469583:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403455.469758:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623dd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c4d expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.469915:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.469932:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.469942:0:17224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 25 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.469952:0:17224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.470068:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 25 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.470085:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 25 pid: 17226 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403455.470102:0:17224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17224:1876325050818048:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403455.470218:0:17224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403455.470247:0:17224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403455.470257:0:17224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17224:1876325050818176:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403455.470285:0:17224:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403455.473675:0:17224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17224:1876325050818048:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403455.474071:0:17224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17224:1876325050818176:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403455.474104:0:17224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403455.474937:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.475227:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038164096 00000100:00100000:2.0:1789403455.475238:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038164096 00010000:00010000:2.0:1789403455.475285:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 26 pid: 17226 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403455.475330:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1789403455.475340:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+26:2390:x1876325038164096:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403455.475357:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403455.475364:0:17209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 26 pid: 17226 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.475378:0:17209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 26 pid: 17226 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.475433:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762397 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c31 expref: 26 pid: 17226 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.475488:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403455.475493:0:17209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.475503:0:17209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.475511:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403455.475616:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+25:2390:x1876325038164096:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 277us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403455.475624:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:1.0:1789403455.478980:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.479076:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038164224 00000100:00100000:2.0:1789403455.479090:0:17210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038164224 00010000:00010000:2.0:1789403455.479143:0:17210:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403455.479190:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1789403455.479202:0:17210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+25:2390:x1876325038164224:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403455.479223:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403455.479231:0:17210:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.479250:0:17210:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.479277:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6c00/0x5fb08b1e5b762382 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c2a expref: 25 pid: 17224 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.479321:0:17210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403455.479326:0:17210:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.479336:0:17210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.479345:0:17210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.479382:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403455.479488:0:17210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:2390:x1876325038164224:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 279us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403455.479497:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00010000:00010000:0.0:1789403455.480113:0:17224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.480125:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403455.480150:0:17224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:0.0:1789403455.480184:0:17224:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:0.0:1789403455.480369:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6a00/0x5fb08b1e5b7623dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c4d expref: 25 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.480440:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c4d expref: 24 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.480449:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403455.480452:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789403455.480455:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7800, rc 0) 00000100:00100000:0.0:1789403455.480685:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:15639:x1876325038163968:12345-192.168.203.43@tcp:101:dd.0 Request processed in 11138us (11399us total) trans 8589934609 rc 0/0 00000100:00100000:0.0:1789403455.480693:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1789403455.484132:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.484638:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038164352 00000100:00100000:2.0:1789403455.484652:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038164352 00000100:00100000:2.0:1789403455.484757:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1789403455.484778:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+24:15639:x1876325038164352:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:2.0:1789403455.484811:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403455.484839:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7623f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c54 expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.484882:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.484898:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.484935:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.485095:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b7623f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 26 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.485118:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 25 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403455.485127:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403455.485130:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403455.485134:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184600, rc 0) 00000100:00100000:2.0:1789403455.485260:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+25:15639:x1876325038164352:12345-192.168.203.43@tcp:101:dd.0 Request processed in 493us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403455.485269:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1789403455.488410:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.488500:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038164608 00000100:00100000:0.0:1789403455.488513:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038164608 00000100:00100000:0.0:1789403455.488582:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:0.0:1789403455.488593:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+25:15639:x1876325038164608:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:0.0:1789403455.488900:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.488920:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.488934:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403455.488999:0:17225:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:0.0:1789403455.489022:0:17225:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f826972d reply state 00000000edcd3316 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.489052:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.489061:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403455.489064:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403455.489069:0:17225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789403455.489450:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+28:15639:x1876325038164608:12345-192.168.203.43@tcp:36:dd.0 Request processed in 856us (1074us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1789403455.489459:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000020:00080000:0.0:1789403455.489465:0:17225:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789403455.491763:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.491884:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038164736 00000100:00100000:0.0:1789403455.491897:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038164736 00000100:00100000:0.0:1789403455.492027:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1789403455.492039:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+28:15639:x1876325038164736:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1789403455.492067:0:17226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403455.492094:0:17226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762407 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c5b expref: -99 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.492161:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762407 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c5b expref: 29 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.492177:0:17226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762407 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c5b expref: 29 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.492354:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403455.492359:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789403455.492363:0:17226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8a00, rc 0) 00000100:00100000:0.0:1789403455.492946:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15639:x1876325038164736:12345-192.168.203.43@tcp:101:dd.0 Request processed in 906us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.492954:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1789403455.504245:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.504370:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038164992 00000100:00100000:2.0:1789403455.504383:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038164992 00000100:00100000:0.0:1789403455.504752:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:0.0:1789403455.504765:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15639:x1876325038164992:12345-192.168.203.43@tcp:103:dd.0 00010000:00010000:0.0:1789403455.504797:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403455.504829:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762407 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c5b expref: 29 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.504854:0:17209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403455.504861:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403455.505040:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+28:15639:x1876325038164992:12345-192.168.203.43@tcp:103:dd.0 Request processed in 277us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.505049:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1789403455.507713:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.507827:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165120 00000100:00100000:0.0:1789403455.507840:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165120 00000100:00100000:0.0:1789403455.508026:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1789403455.508041:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+28:15639:x1876325038165120:12345-192.168.203.43@tcp:58:dd.0 00010000:00010000:0.0:1789403455.508184:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.508206:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403455.508221:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403455.509281:0:17225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403455.509707:0:17225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789403455.509905:0:17225:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789403455.510168:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+28:15639:x1876325038165120:12345-192.168.203.43@tcp:58:dd.0 Request processed in 2125us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.510180:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:2.0:1789403455.512609:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403455.512687:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165248 00000100:00100000:1.0:1789403455.512700:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165248 00000100:00100000:1.0:1789403455.512809:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1789403455.512821:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+28:15639:x1876325038165248:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:1.0:1789403455.512847:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403455.512873:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c62 expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.513040:0:19353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.513054:0:19353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 29 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.513077:0:19353:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.513091:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 29 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.513107:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403455.513110:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403455.513114:0:19353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 29 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403455.513122:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062400, rc 0) 00000100:00100000:1.0:1789403455.513202:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15639:x1876325038165248:12345-192.168.203.43@tcp:101:dd.0 Request processed in 384us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403455.513210:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:1.0:1789403455.568555:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.569375:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165376 00000100:00100000:0.0:1789403455.569420:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165376 00000100:00100000:0.0:1789403455.569502:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:0.0:1789403455.569515:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2390:x1876325038165376:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403455.569645:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2390:x1876325038165376:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 132us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.569654:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 163 00000100:00100000:2.0:1789403455.573914:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.573975:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.574097:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.574131:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403455.574175:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165504 00000100:00100000:0.0:1789403455.574188:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165504 00000100:00100000:0.0:1789403455.574260:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166016 00000100:00100000:0.0:1789403455.574263:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166016 00000100:00100000:0.0:1789403455.574290:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1789403455.574303:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038165504:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403455.574327:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1789403455.574341:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038166016:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403455.575017:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038165504:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 714us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.575027:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:1.0:1789403455.575125:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038166016:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 787us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403455.575153:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1789403455.575299:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165760 00000100:00100000:3.0:1789403455.575306:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165760 00000100:00100000:3.0:1789403455.575354:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166272 00000100:00100000:3.0:1789403455.575357:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166272 00000100:00100000:3.0:1789403455.575503:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1789403455.575511:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038165760:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403455.575553:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038165760:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403455.575559:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1789403455.575574:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1789403455.575581:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038166272:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403455.575606:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038166272:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403455.575619:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00080000:3.0:1789403455.575639:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403455.577611:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.577746:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403455.577819:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403455.577874:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165888 00000100:00100000:1.0:1789403455.577888:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165888 00000100:00100000:1.0:1789403455.577946:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1789403455.577956:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:2389:x1876325038165888:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403455.578052:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+12:2389:x1876325038165888:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403455.578061:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1789403455.578279:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038165632 00000100:00100000:3.0:1789403455.578280:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166144 00000100:00100000:3.0:1789403455.578284:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166144 00000100:00100000:0.0:1789403455.578284:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038165632 00000100:00100000:0.0:1789403455.578375:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:0.0:1789403455.578384:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038165632:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403455.578563:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038165632:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 72us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.578581:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00080000:2.0:1789403455.579308:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403455.579751:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403455.579764:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038166144:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403455.579892:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038166144:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 132us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403455.579900:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00010000:00010000:0.0:1789403455.729691:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403456.049729:0:17259:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789403456.049748:0:17259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403456.049797:0:17259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789403456.049810:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789403456.049998:0:17259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17259:1876325050818304:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789403456.050187:0:17259:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a54e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789403456.056614:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403456.056755:0:17259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17259:1876325050818304:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789403456.056955:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166400 00000100:00100000:1.0:1789403456.056973:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166400 00000100:00100000:1.0:1789403456.057423:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:1.0:1789403456.057439:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15640:x1876325038166400:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789403456.057494:0:17224:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789403456.057654:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15640:x1876325038166400:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 219us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.057663:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00080000:2.0:1789403456.058638:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403456.060595:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.069421:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166528 00000100:00100000:0.0:1789403456.069443:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166528 00000100:00100000:0.0:1789403456.069626:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:0.0:1789403456.069640:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15640:x1876325038166528:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789403456.069738:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.069759:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070370:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070422:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070431:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070439:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070498:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070510:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070518:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403456.070662:0:17226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789403456.070668:0:17226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789403456.070686:0:17226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070699:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070706:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070714:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070721:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403456.070726:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070735:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.070749:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a27c1d4700) 00010000:00010000:0.0:1789403456.070758:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403456.070765:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071320:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9a00/0x5fb08b1e5b76241c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071343:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071349:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071356:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071362:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403456.071374:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071382:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071452:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90a27c1d4600) 00010000:00010000:0.0:1789403456.071455:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403456.071459:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071465:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8a00/0x5fb08b1e5b762423 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071483:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071496:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071503:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071508:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403456.071511:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071518:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071526:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403456.071528:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403456.071531:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.071885:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1e00/0x5fb08b1e5b76242a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403456.072009:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15640:x1876325038166528:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 2367us (11420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403456.072019:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:3.0:1789403456.074811:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.088184:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166784 00000100:00100000:1.0:1789403456.088207:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166784 00000100:00100000:1.0:1789403456.088411:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1789403456.088427:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+29:15640:x1876325038166784:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403456.092454:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403456.092501:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b762431 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c69 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.092734:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.092906:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.092924:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403456.092939:0:17225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00020000:0.0:1789403456.092950:0:17225:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:0.0:1789403456.093058:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093067:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093075:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093082:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403456.093088:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093096:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093111:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403456.093114:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789403456.093120:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093127:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0c00/0x5fb08b1e5b762438 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093196:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b762431 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c69 expref: 31 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093207:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a27c1d4700) 00010000:00010000:0.0:1789403456.093210:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789403456.093214:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0a00/0x5fb08b1e5b762431 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c69 expref: 31 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.093224:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0a00, rc 0) 00000100:00100000:0.0:1789403456.094516:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+30:15640:x1876325038166784:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6081us (19703us total) trans 8589934612 rc 301/301 00000100:00100000:0.0:1789403456.094532:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:0.0:1789403456.101614:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.101823:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038166912 00000100:00100000:1.0:1789403456.101909:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038166912 00000100:00100000:1.0:1789403456.101992:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:1.0:1789403456.102005:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+30:15640:x1876325038166912:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789403456.102253:0:17226:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789403456.102473:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+30:15640:x1876325038166912:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 469us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.102552:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:3.0:1789403456.152565:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.152968:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038167168 00000100:00100000:1.0:1789403456.152983:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038167168 00000100:00100000:1.0:1789403456.153066:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1789403456.153079:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+30:15640:x1876325038167168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.153123:0:17224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403456.153151:0:17224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b762446 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c70 expref: -99 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403456.153720:0:17224:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:1.0:1789403456.153730:0:17224:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789403456.153756:0:17224:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789403456.154437:0:17224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76244d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.154458:0:17224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76244d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.154605:0:17224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76244d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403456.154616:0:17224:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:1.0:1789403456.154632:0:17224:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:1.0:1789403456.154697:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b762446 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c70 expref: 33 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.154720:0:17224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76244d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c70 expref: 32 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.154753:0:17224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512a00) 00010000:00010000:1.0:1789403456.154757:0:17224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403456.154762:0:17224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:1.0:1789403456.155006:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+32:15640:x1876325038167168:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 1927us (2455us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789403456.155017:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:3.0:1789403456.163812:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.164460:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038167424 00000100:00100000:1.0:1789403456.164479:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038167424 00000100:00100000:1.0:1789403456.164549:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:1.0:1789403456.164560:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+32:15640:x1876325038167424:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.164636:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403456.164675:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76244d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c70 expref: 32 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.164698:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512a00) 00010000:00010000:1.0:1789403456.164710:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403456.164737:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.164754:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.164773:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.164788:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.164817:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.164824:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165214:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165223:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165230:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165236:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.165240:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165249:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165258:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:1.0:1789403456.165261:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403456.165265:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165271:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76245b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165281:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165294:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165300:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165304:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.165307:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165312:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165319:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xad272b8f (ffff90a142512300) 00010000:00010000:1.0:1789403456.165321:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403456.165323:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.165329:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762462 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xad272b8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.165483:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+31:15640:x1876325038167424:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 925us (1683us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403456.165491:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:0.0:1789403456.169691:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.169793:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038167552 00000100:00100000:1.0:1789403456.169807:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038167552 00000100:00100000:1.0:1789403456.169891:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1789403456.169904:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+31:15640:x1876325038167552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.169930:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403456.169977:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b762469 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c77 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.170027:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b762470 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.170045:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b762470 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.170058:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b762470 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.170205:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b762469 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c77 expref: 33 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.170228:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b762470 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c77 expref: 32 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.170238:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.170241:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403456.170245:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063200, rc 0) 00000100:00100000:1.0:1789403456.170328:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+32:15640:x1876325038167552:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 427us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.170335:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:0.0:1789403456.177462:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.177675:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038167808 00000100:00100000:1.0:1789403456.177688:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038167808 00000100:00100000:1.0:1789403456.177757:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:1.0:1789403456.177777:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+32:15640:x1876325038167808:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.177890:0:17226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.177926:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.177940:0:17226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403456.178143:0:17226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789403456.178265:0:17226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 502176874503ns, next at 503176871170ns, rc = 0 00000004:00010000:1.0:1789403456.178321:0:17226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090d5b91c reply state 000000003f272dd1 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.178336:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.178344:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.178348:0:17226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789403456.178352:0:17226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789403456.178653:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+34:15640:x1876325038167808:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 886us (1203us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789403456.179539:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1789403456.184612:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.184830:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038167936 00000100:00100000:1.0:1789403456.184853:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038167936 00000100:00100000:1.0:1789403456.184927:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1789403456.184940:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+34:15640:x1876325038167936:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.184985:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403456.185019:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c7e expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.185120:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 35 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.185138:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 35 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.185162:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.185166:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403456.185171:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063400, rc 0) 00000100:00100000:1.0:1789403456.185247:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+35:15640:x1876325038167936:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 310us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.185254:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1789403456.195336:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.195689:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038168064 00000100:00100000:1.0:1789403456.195704:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038168064 00000100:00100000:1.0:1789403456.195849:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:1.0:1789403456.195862:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038168064:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789403456.196197:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2390:x1876325038168064:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 337us (876us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789403456.196207:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1789403456.203378:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403456.207023:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038168320 00000100:00100000:2.0:1789403456.207048:0:17227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038168320 00000100:00100000:2.0:1789403456.207226:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1789403456.207240:0:17227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+35:15640:x1876325038168320:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789403456.207577:0:17227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+36:15640:x1876325038168320:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 340us (4214us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789403456.207586:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:0.0:1789403456.212804:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403456.212903:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038168576 00000100:00100000:3.0:1789403456.212919:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038168576 00000100:00100000:3.0:1789403456.214038:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:3.0:1789403456.214471:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+36:15640:x1876325038168576:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789403456.215087:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+36:15640:x1876325038168576:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 1016us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403456.215099:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:0.0:1789403456.223647:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.223810:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038168704 00000100:00100000:1.0:1789403456.223823:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038168704 00000100:00100000:1.0:1789403456.223982:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1789403456.223994:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+36:15640:x1876325038168704:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.224024:0:17225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403456.224072:0:17225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b762485 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c85 expref: -99 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.224172:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76248c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.224190:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76248c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.224206:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76248c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403456.224264:0:17225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403456.224289:0:17225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76248c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.229250:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b762485 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c85 expref: 38 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.229321:0:17225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76248c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c85 expref: 37 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.229333:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.229336:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789403456.229340:0:17225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:0.0:1789403456.229684:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+37:15640:x1876325038168704:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 5689us (6048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403456.229697:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:2.0:1789403456.239560:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.239748:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038168832 00000100:00100000:1.0:1789403456.239762:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038168832 00000100:00100000:1.0:1789403456.239864:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:1.0:1789403456.239877:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+6:2389:x1876325038168832:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.239901:0:19834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403456.239947:0:19834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c8c expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403456.239983:0:19834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa82140, blocks: 0x0 00010000:00010000:1.0:1789403456.240010:0:19834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=502s v=(0 0) 00010000:00010000:1.0:1789403456.240015:0:19834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403456.240027:0:19834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 7 pid: 19834 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.240051:0:19834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 7 pid: 19834 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.240068:0:19834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063a00, rc 0) 00000100:00100000:1.0:1789403456.240142:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2389:x1876325038168832:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 268us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.240150:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403456.260447:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.260628:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169088 00000100:00100000:1.0:1789403456.260643:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169088 00000100:00100000:1.0:1789403456.260722:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403456.260736:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+37:15640:x1876325038169088:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789403456.261071:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+37:15640:x1876325038169088:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 336us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.261080:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1789403456.264103:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403456.264250:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169216 00000100:00100000:3.0:1789403456.264266:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169216 00000100:00100000:3.0:1789403456.264349:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403456.264362:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+37:15640:x1876325038169216:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789403456.274058:0:17204:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:0.0:1789403456.274083:0:17204:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789403456.274155:0:17204:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789403456.275109:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403456.275135:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050818432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789403456.275227:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403456.275289:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050818432 00000100:00100000:3.0:1789403456.275299:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050818432 00000100:00100000:3.0:1789403456.275373:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403456.275386:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050818432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789403456.275587:0:18733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789403456.275591:0:18733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789403456.275593:0:18733:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789403456.275612:0:18733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789403456 -> 1789403456 00002000:00010000:3.0:1789403456.275614:0:18733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789403456.275658:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1876325050818432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 275us (431us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789403456.275666:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1789403456.275722:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a142500700/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789403456.275729:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050818432:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789403456.275745:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403456.275931:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+19:15640:x1876325038169216:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 11569us (11839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403456.275940:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00010000:00010000:1.0:1789403456.279296:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.279322:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.279351:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.279358:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.279363:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.279373:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.279442:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:1.0:1789403456.279446:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789403456.279452:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.279459:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762320 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403456.281169:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00010000:00010000:2.0:1789403456.281380:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281416:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281427:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281435:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403456.281464:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281487:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281511:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a27c1d4100) 00010000:00010000:2.0:1789403456.281516:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403456.281522:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281529:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8600/0x5fb08b1e5b7622cc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281567:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281575:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281581:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281587:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403456.281590:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281596:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281604:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:2.0:1789403456.281607:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403456.281618:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281625:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8c00/0x5fb08b1e5b7622d3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281645:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281652:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281658:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281662:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403456.281665:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281673:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281681:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90a1434a8200) 00010000:00010000:2.0:1789403456.281683:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403456.281687:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281693:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6800/0x5fb08b1e5b76237b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281713:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281729:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281735:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281740:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403456.281744:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281750:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281758:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403456.281760:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403456.281775:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281783:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762400 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281796:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281802:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281808:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281813:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403456.281821:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.281828:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.282029:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:2.0:1789403456.282035:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789403456.282039:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.282045:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062200/0x5fb08b1e5b762477 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.282195:0:19833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169344 00000100:00100000:1.0:1789403456.282210:0:19833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169344 00000100:00100000:1.0:1789403456.282284:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1789403456.282295:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2387:x1876325038169344:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789403456.282603:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2387:x1876325038169344:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 181us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.282613:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403456.292866:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.292986:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169600 00000100:00100000:0.0:1789403456.293001:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169600 00000100:00100000:0.0:1789403456.293077:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1789403456.293089:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+15:15640:x1876325038169600:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789403456.293162:0:19353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403456.293198:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063000/0x5fb08b1e5b76248c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c85 expref: 15 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.293224:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:0.0:1789403456.293231:0:19353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403456.293269:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.293287:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.293298:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403456.293526:0:19353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aac6504f reply state 000000004db06a3c transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.293540:0:19353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.293546:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:0.0:1789403456.293549:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403456.293568:0:19353:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789403456.293692:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:15640:x1876325038169600:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 604us (840us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1789403456.293700:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1789403456.303556:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.303727:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169728 00000100:00100000:0.0:1789403456.303744:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169728 00000100:00100000:0.0:1789403456.303828:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:0.0:1789403456.303851:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27caec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:15640:x1876325038169728:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789403456.303877:0:18732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403456.303900:0:18732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c93 expref: -99 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.303942:0:18732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.303962:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403456.303967:0:18732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403456.303974:0:18732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 8 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.304020:0:18732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.304036:0:18732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403456.304052:0:18732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18732:1876325050818560:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403456.304187:0:18732:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403456.310490:0:18732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18732:1876325050818560:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403456.310543:0:18732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 8 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.310572:0:18732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0400, rc 0) 00000100:00100000:0.0:1789403456.310650:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27caec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+8:15640:x1876325038169728:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 6811us (7109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403456.310660:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1789403456.318187:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.318727:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169856 00000100:00100000:1.0:1789403456.318742:0:17210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169856 00010000:00010000:1.0:1789403456.318814:0:17210:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.318912:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403456.318925:0:17210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+8:2389:x1876325038169856:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403456.318946:0:17210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403456.318990:0:17210:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.319018:0:17210:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.319050:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762493 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c8c expref: 8 pid: 19834 timeout: 602 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.319075:0:17210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403456.319081:0:17210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403456.319090:0:17210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 7 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.319102:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 7 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.319155:0:17210:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 7 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.319186:0:17210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17210:1876325050818688:192.168.203.43@tcp:105: 00000100:00100000:1.0:1789403456.319309:0:17210:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7bec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403456.324696:0:17210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17210:1876325050818688:192.168.203.43@tcp:105: 00010000:00010000:1.0:1789403456.324738:0:17210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403456.324827:0:17210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2389:x1876325038169856:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5904us (6657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.325702:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403456.326894:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403456.326962:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038169984 00000100:00100000:3.0:1789403456.326974:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038169984 00000100:00100000:3.0:1789403456.327035:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403456.327047:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2389:x1876325038169984:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789403456.327245:0:18731:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789403456.327249:0:18731:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789403455 00002000:00010000:3.0:1789403456.327252:0:18731:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789403454 00002000:00010000:3.0:1789403456.327254:0:18731:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789403456 -> 1789403455 00002000:00010000:3.0:1789403456.327257:0:18731:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789403456.327650:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+8:2389:x1876325038169984:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 604us (761us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789403456.327659:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:2.0:1789403456.331425:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.331628:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038170112 00000100:00100000:1.0:1789403456.331642:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038170112 00000100:00100000:1.0:1789403456.331719:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1789403456.331732:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+8:2390:x1876325038170112:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789403456.331797:0:19834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.331824:0:19834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 8 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.331898:0:19834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403456.331904:0:19834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789403456.331910:0:19834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.332125:0:19834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 8 pid: 18732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.332165:0:19834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 8 pid: 18732 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.332182:0:19834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19834:1876325050818816:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403456.332323:0:19834:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403456.343123:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403456.343288:0:19834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19834:1876325050818816:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403456.343337:0:19834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403456.343534:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038170240 00000100:00100000:3.0:1789403456.343544:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038170240 00010000:00010000:3.0:1789403456.343603:0:17979:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 9 pid: 18732 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403456.343654:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1789403456.343665:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+9:2390:x1876325038170240:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403456.343693:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403456.343722:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 9 pid: 18732 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.343739:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 9 pid: 18732 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.343779:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c079d2/0x5fb08b1e5b7624a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c93 expref: 9 pid: 18732 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.343801:0:17979:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403456.343806:0:17979:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403456.343812:0:17979:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.343824:0:17979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.343863:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403456.343951:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+8:2390:x1876325038170240:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 286us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403456.343960:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:1.0:1789403456.344122:0:19834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344132:0:19834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344156:0:19834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344180:0:19834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344190:0:19834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344211:0:19834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403456.344216:0:19834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344226:0:19834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344248:0:19834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.344257:0:19834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b7624a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.344326:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2390:x1876325038170112:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 12597us (12944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.344335:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:0.0:1789403456.357336:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403456.357531:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038170496 00000100:00100000:2.0:1789403456.357551:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038170496 00000100:00100000:0.0:1789403456.357749:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:0.0:1789403456.357761:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:15640:x1876325038170496:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789403456.357881:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.357902:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 16 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.357913:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.357965:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 16 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.357980:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 16 pid: 19353 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403456.358026:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17225:1876325050818944:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403456.358132:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403456.361739:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.362295:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17225:1876325050818944:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403456.362335:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403456.362636:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038170624 00000100:00100000:2.0:1789403456.362645:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038170624 00010000:00010000:2.0:1789403456.362693:0:17211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 17 pid: 19353 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403456.362747:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403456.362758:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+17:2389:x1876325038170624:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403456.362784:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403456.362793:0:17211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 17 pid: 19353 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.362835:0:17211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 17 pid: 19353 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.362864:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7623f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c54 expref: 17 pid: 19353 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.362883:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:2.0:1789403456.362890:0:17211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 16 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.362901:0:17211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.362910:0:17211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.362919:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.363137:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403456.363249:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:2389:x1876325038170624:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 492us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403456.363258:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00010000:00010000:0.0:1789403456.363431:0:17225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.363439:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.363689:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.363703:0:17225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 16 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.363712:0:17225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.363748:0:17225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 16 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.363761:0:17225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 16 pid: 17225 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403456.363787:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17225:1876325050819072:192.168.203.43@tcp:104: 00000100:00100000:0.0:1789403456.363863:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25d7a5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403456.366946:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.367062:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17225:1876325050819072:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403456.367168:0:17225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403456.367243:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038170752 00000100:00100000:3.0:1789403456.367252:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038170752 00010000:00010000:3.0:1789403456.367298:0:17209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 17 pid: 17225 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.367470:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1789403456.367492:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+17:2390:x1876325038170752:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403456.367512:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403456.367520:0:17979:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 17 pid: 17225 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.367534:0:17979:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 17 pid: 17225 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.367594:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063400/0x5fb08b1e5b76247e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c7e expref: 17 pid: 17225 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.367614:0:17979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.367620:0:17979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.367631:0:17979:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.367640:0:17979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.367679:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403456.367746:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:2390:x1876325038170752:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 258us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403456.367754:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:0.0:1789403456.368111:0:17225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.368120:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403456.368269:0:17225:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789403456.369059:0:17225:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:0.0:1789403456.369163:0:17225:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789403456.369275:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17225:1876325050819200:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789403456.369368:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403456.369535:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a144541840 going to sleep for 11 seconds 00000100:00100000:2.0:1789403456.369664:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050819200 00000100:00100000:2.0:1789403456.369673:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050819200 00000100:00100000:2.0:1789403456.369773:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789403456.369785:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1876325050819200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789403456.370124:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1876325050819200:12345-0@lo:1000:mdt00_001.0 Request processed in 340us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403456.370132:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789403456.370159:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17225:1876325050819200:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789403456.370425:0:17225:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:1.0:1789403456.370485:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17225:1876325050819328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789403456.370524:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403456.370550:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7bea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403456.370604:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050819328 00000100:00100000:0.0:1789403456.370610:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050819328 00000100:00100000:0.0:1789403456.370648:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789403456.370656:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17225:x1876325050819328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789403456.371097:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17225:x1876325050819328:12345-0@lo:1000:mdt00_001.0 Request processed in 439us (570us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789403456.371105:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789403456.371279:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17225:1876325050819328:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789403456.371527:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371541:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371563:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371572:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.371578:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371588:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371619:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.371623:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403456.371631:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371638:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1200/0x5fb08b1e5b7624b6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371682:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371690:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371697:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371703:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.371706:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371722:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371731:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403456.371734:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789403456.371742:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 19 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371754:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 19 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371773:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 19 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.371850:0:17225:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 19 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.371866:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17225:1876325050819456:192.168.203.43@tcp:105: 00000100:00100000:1.0:1789403456.372783:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403456.377153:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17225:1876325050819456:192.168.203.43@tcp:105: 00000100:00100000:3.0:1789403456.377442:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403456.377523:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038170880 00000100:00100000:2.0:1789403456.377536:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038170880 00000100:00100000:2.0:1789403456.377605:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:2.0:1789403456.377617:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27db0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15639:x1876325038170880:12345-192.168.203.43@tcp:49:dd.0 00000100:00100000:2.0:1789403456.377799:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27db0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15639:x1876325038170880:12345-192.168.203.43@tcp:49:dd.0 Request processed in 180us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403456.377807:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00010000:00010000:1.0:1789403456.378908:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.378985:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9400/0x5fb08b1e5b76240e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379030:0:17225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379067:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379127:0:17225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379140:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379148:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379155:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379162:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.379167:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.379175:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.381032:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403456.381045:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403456.381055:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.381065:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063a00/0x5fb08b1e5b7624bd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403456.381496:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.381622:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171008 00000100:00100000:0.0:1789403456.381637:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171008 00000100:00100000:0.0:1789403456.381705:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:0.0:1789403456.381716:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15639:x1876325038171008:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1789403456.381761:0:19353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403456.381793:0:19353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7624c4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128c9a expref: -99 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.381842:0:19353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.381856:0:19353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.381866:0:19353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.381890:0:19353:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.381905:0:19353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382544:0:17225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382564:0:17225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382572:0:17225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382579:0:17225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403456.382582:0:17225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382591:0:17225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382657:0:17225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:1.0:1789403456.382660:0:17225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789403456.382664:0:17225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382672:0:17225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382679:0:17225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382750:0:17225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.382758:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1000/0x5fb08b1e5b7624af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.383118:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+21:15640:x1876325038170496:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 25355us (25794us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1789403456.383136:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000020:00080000:1.0:1789403456.383143:0:17225:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:0.0:1789403456.383679:0:19353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.383690:0:19353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.383849:0:19353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0800/0x5fb08b1e5b7624c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c9a expref: 21 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.383867:0:19353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c9a expref: 20 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.383888:0:19353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403456.383891:0:19353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789403456.383894:0:19353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1400, rc 0) 00000100:00100000:0.0:1789403456.383954:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15639:x1876325038171008:12345-192.168.203.43@tcp:101:dd.0 Request processed in 2239us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403456.383961:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000040:00080000:2.0:1789403456.384842:0:17259:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789403456.384851:0:17259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789403456.384874:0:17259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789403456.384881:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789403456.389845:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403456.390051:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171264 00000100:00100000:3.0:1789403456.390065:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171264 00000100:00100000:3.0:1789403456.390151:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:3.0:1789403456.390163:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+20:15640:x1876325038171264:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789403456.391323:0:17228:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789403456.391370:0:17228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:2.0:1789403456.391803:0:17228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.391826:0:17228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.391840:0:17228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.391850:0:17228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.391873:0:17228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.391881:0:17228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403456.391962:0:17228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789403456.392110:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:15640:x1876325038171264:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 1944us (2276us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789403456.392120:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000020:00080000:2.0:1789403456.392128:0:17228:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789403456.399813:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403456.399833:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.399847:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403456.399852:0:17978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.399864:0:17978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.399887:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:1.0:1789403456.399891:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789403456.399897:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.399905:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b7624d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.400234:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403456.400238:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403456.400240:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403456.561907:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403456.562062:0:18736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171392 00000100:00100000:0.0:1789403456.562074:0:18736:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171392 00000100:00100000:0.0:1789403456.562180:0:18736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:0.0:1789403456.562195:0:18736:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2390:x1876325038171392:12345-192.168.203.43@tcp:4:dd.0 00002000:00010000:0.0:1789403456.562263:0:18736:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa8213f, atime: 0x6aa8213e, ctime: 0x6aa8213f, blocks: 0x0 00010000:00010000:0.0:1789403456.562277:0:18736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.562310:0:18736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=502s v=(0 0) 00010000:00010000:0.0:1789403456.562316:0:18736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403456.562325:0:18736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403456.562344:0:18736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403456.568697:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403456.568981:0:18738:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789403456.568994:0:18738:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789403456.569745:0:18738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171520 00000100:00100000:2.0:1789403456.569759:0:18738:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171520 00000100:00100000:3.0:1789403456.570597:0:20365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1789403456.570615:0:20365:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+8:2390:x1876325038171520:12345-192.168.203.43@tcp:4:dd.0 00010000:00010000:3.0:1789403456.570667:0:20365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.570691:0:20365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403456.570696:0:20365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403456.570704:0:20365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403456.570723:0:20365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789403456.685837:0:18727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789403456.685869:0:18727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1789403456.686024:0:20365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1789403456.686029:0:20365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789403455 -> 1789403456 00002000:00010000:1.0:1789403456.686032:0:20365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789403455 -> 1789403456 00002000:00010000:1.0:1789403456.686034:0:20365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1789403456.686051:0:20365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.686064:0:20365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.686085:0:20365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.686091:0:20365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403456.686095:0:20365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.686104:0:20365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.686124:0:20365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.686131:0:20365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005817be66/0x5fb08b1e5b7624e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.686250:0:20365:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+7:2390:x1876325038171520:12345-192.168.203.43@tcp:4:dd.0 Request processed in 115636us (117564us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789403456.686264:0:20365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000001:00080000:2.0:1789403456.729840:0:18727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1789403456.730248:0:18736:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1789403456.730268:0:18736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.730281:0:18736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.730305:0:18736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.730312:0:18736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403456.730317:0:18736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.730326:0:18736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.730345:0:18736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403456.730353:0:18736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a2444b3/0x5fb08b1e5b7624d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403456.730557:0:18736:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038171392:12345-192.168.203.43@tcp:4:dd.0 Request processed in 168361us (168661us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789403456.730569:0:18736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00010000:00010000:0.0:1789403456.754901:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403457.266053:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403457.266078:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050819584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403457.266149:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403457.266244:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050819584 00000100:00100000:1.0:1789403457.266261:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050819584 00000100:00100000:1.0:1789403457.266342:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403457.266352:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050819584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403457.266374:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1789403457.266439:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050819584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403457.266460:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789403457.266649:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050819584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789403457.267272:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403457.777988:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050819712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403457.778065:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403457.778239:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050819712 00000100:00100000:2.0:1789403457.778247:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050819712 00000100:00100000:2.0:1789403457.778297:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789403457.778305:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050819712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403457.778341:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403457.778413:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050819712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403457.778420:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789403457.778590:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050819712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403457.778875:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403457.778884:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050819840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403457.778912:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403457.779172:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050819840 00000100:00100000:2.0:1789403457.779177:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050819840 00000100:00100000:2.0:1789403457.779211:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789403457.779218:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1440ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050819840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403457.779254:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789403457.779301:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1440ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050819840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403457.779307:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403457.779855:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050819840:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403457.780200:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789403458.265722:0:20402:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789403458.803646:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789403458.804625:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403459.826581:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403459.826767:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050820096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403459.826876:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403459.826928:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403459.826935:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1440ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050819968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403459.826959:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403459.826995:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820096 00000100:00100000:3.0:1789403459.827005:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820096 00000100:00100000:3.0:1789403459.827068:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050819968 00000100:00100000:3.0:1789403459.827071:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050819968 00000100:00100000:3.0:1789403459.827096:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403459.827105:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050820096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403459.827146:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403459.827197:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050820096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403459.827203:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403459.827223:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403459.827230:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050819968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403459.827239:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403459.827274:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050819968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403459.827280:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403459.827352:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050819968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403459.827365:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1440ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050820096:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789403459.833713:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403459.833760:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403459.833849:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403459.833914:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820224 00000100:00100000:2.0:1789403459.833923:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820224 00000100:00100000:2.0:1789403459.833987:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403459.833997:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050820224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403459.834035:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789403459.834085:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050820224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403459.834092:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789403459.834115:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403459.834339:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050820480:0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.835600:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050820608:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.836604:0:3628:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1789403459.836614:0:3628:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a142500700, transno 8589934596 00000004:00080000:2.0:1789403459.836630:0:3628:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1789403459.836675:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403459.836705:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050820736:0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.840660:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403459.840754:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050820992:0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.840797:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403459.840817:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050821504:0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.840840:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403459.840894:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820992 00000100:00100000:0.0:1789403459.840904:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820992 00000100:00100000:0.0:1789403459.840956:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821504 00000100:00100000:0.0:1789403459.840959:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821504 00000100:00100000:0.0:1789403459.841002:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789403459.841012:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050820992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.841075:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050820992:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.841083:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789403459.841102:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403459.841108:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050821504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.841135:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050821504:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.841153:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403459.841202:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050820992:0@lo:400:kworker.0 00010000:00080000:0.0:1789403459.841217:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144183800 x1876325050821504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403459.841228:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050821504:0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.841338:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820480 00000100:00100000:3.0:1789403459.841344:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820480 00000100:00100000:3.0:1789403459.841404:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789403459.841413:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050820480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.841538:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050820480:12345-0@lo:400:kworker.0 Request processed in 127us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403459.841545:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789403459.841607:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403459.841628:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050821120:0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.841650:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789403459.841729:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403459.841756:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050820352:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.841795:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403459.841842:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050820864:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.841869:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403459.841885:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050821376:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.841904:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403459.842081:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403459.842106:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820736 00000100:00100000:2.0:1789403459.842111:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820736 00000100:00100000:2.0:1789403459.842145:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789403459.842152:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050820736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.842186:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050820736:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403459.842193:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789403459.842234:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050820736:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.842242:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050821248:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.842263:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403459.842283:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820608 00000100:00100000:2.0:1789403459.842287:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820608 00000100:00100000:2.0:1789403459.842306:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821120 00000100:00100000:2.0:1789403459.842309:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821120 00000100:00100000:2.0:1789403459.842330:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821376 00000100:00100000:2.0:1789403459.842333:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821376 00000100:00100000:2.0:1789403459.842346:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821248 00000100:00100000:2.0:1789403459.842349:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821248 00000100:00100000:2.0:1789403459.842363:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789403459.842369:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050820608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.842434:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050820608:12345-0@lo:400:kworker.0 Request processed in 65us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.842626:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789403459.842635:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050821120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.842671:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050821120:12345-0@lo:400:kworker.0 Request processed in 38us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.842677:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789403459.842692:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789403459.842699:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050821376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.842730:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050821376:12345-0@lo:400:kworker.0 Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.842736:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789403459.842762:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789403459.842769:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050821248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.842795:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050821248:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.842801:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789403459.842823:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820864 00000100:00100000:0.0:1789403459.842827:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820864 00000100:00100000:0.0:1789403459.842864:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403459.842871:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050820864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403459.842912:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050820864:12345-0@lo:400:kworker.0 Request processed in 42us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403459.842919:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403459.842961:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050820480:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.843549:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789403459.843574:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403459.843579:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403459.843581:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403459.843606:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050820864:0@lo:400:kworker.0 00000100:00100000:2.0:1789403459.843619:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050821376:0@lo:400:kworker.0 00010000:00080000:2.0:1789403459.843653:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a2488b5880 x1876325050821248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403459.843663:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050821248:0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.844628:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050820352 00000100:00100000:3.0:1789403459.844643:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050820352 00000100:00100000:3.0:1789403459.844704:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789403459.844715:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050820352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.844822:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050820352:12345-0@lo:400:kworker.0 Request processed in 109us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403459.844829:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789403459.844894:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050820352:0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.844940:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050820608:0@lo:400:kworker.0 00000100:00100000:3.0:1789403459.844975:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050821120:0@lo:400:kworker.0 Debug log: 41929 lines, 41929 kept, 0 dropped, 0 bad.